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ABSTRACT 

This  thesis  examines  the  "Problem  Solving  Skills  for 
Managers"  training  package,  piloted  by  the  Coast  Guard 
Leadership  and  Management  School  in  April  1983.   Four  ques- 
tionnaire instruments  developed  by  the  company  which  pro- 
duced the  training  package  were  analyzed  to  determine  the 
effectiveness  of  the  training  program.   A  quasi-experimen- 
tal pre-test /post-test /control  group  research  design  was  used 
by  the  Coast  Guard  project  manager  and  this  thesis  used  a 
regression  procedure  to  counteract  any  regression  effect . 
The  results  of  the  analysis  suggest  that  the  training  program 
was  not  effective  as  given  and  suggests  further  study  to 
determine  why  it  was  not  effective. 
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I.   INTRODUCTION 

"The  dollar  spent  on  training  today  is  a  marginal 
dollar.   Today,  more  than  ever,  training  professionals 
must  demonstrate  the  effectiveness  of  their  programs.... 
Spending  money  on  unnecessary  training,  inappropriate 
training,  or  training  that  doesn't  train  can  spell 
disaster  for  those  who  design  such  programs."   [Ref.  1] 

A .   BACKGROUND 

These  introductory  remarks  were  written  by  a  learning 

technology  manager  in  industry,  but  they  apply  equally  well 

to  the  government  sector  in  general  and  to  the  Coast  Guard 

in  particular.   Training  plays  a  vital  role  in  preparing 

Coast  Guard  personnel  for  the  increasingly  complex  skills 

required  to  meet  the  challenges  of  technological  growth. 

Training  is  required  to  insure  that  the  Coast  Guard  can 

take  advantage  of  modern  technology  by  using  all  of  its 

resources  as  effectively  and  efficiently  as  possible.   These 

include  financial,  physical  and  human  resources.   It  has 

been  said  that  people  are  the  Coast  Guard's  most  important 

asset.    Leadership  has  traditionally  been  important  in  the 

military  services  to  insure  the  "good  order  and  discipline" 

of  these  assets.   The  effective  management  of  these  human 

resources  becomes  even  more  important  as  increasing  amounts 


For  example,  see  former  Coast  Guard  Commandant  Admiral 
John  B.  Hayes'  State  of  the  Coast  Guard  address  of  16 
January  1979. 
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of  time  and  money  are  invested  in  their  training  and  develop- 
ment. This  is  one  of  the  reasons  that  leadership  and  manage- 
ment training  is  provided  to  those  in  supervisory  positions. 

The  Coast  Guard  recognizes  the  need  to  efficiently  use 
these  training  dollars  and  has  prescribed  the  responsibili- 
ties and  techniques  for  training  management  [Ref.  2].   One 
of  the  techniques  is  the  use  of  Instructional  Systems 
Development  (ISD),  a  method  of  identifying  training  needs, 
determining  the  optimal  training  methods,  developing  an 
appropriate  training  design,  implementing  and  evaluating 
the  training.   A  diagram  of  the  basic  ISD  process  is  provided 
by  Figure  1.1. 

This  thesis  will  examine  the  "Problem  Solving  Skills  for 
Managers"  training  package,  developed  by  Interact  Performance 
Systems,  Incorporated,  in  1982,  and  piloted  by  the  Coast 
Guard  Leadership  School  during  the  period  5  April  1983  through 
2  August  1983.   The  main  objective  of  the  training  is  for 
supervisors  to  increase  their  effectiveness  in  dealing  with 
interpersonal  problems  in  their  work  settings  by  using  the 
steps  in  the  problem  solving  process  that  are  described  in 
the  training.   In  this  particular  training  program,  parti- 
cipants learn  to  communicate  the  situation  in  a  specific 
and  non-threatening  manner;  to  diagnose  the  situation  as  an 
ability  or  a  motivation  problem;  to  communicate  the  conse- 
quences— natural  (e.g.  the  job  will  not  get  done),  to  others, 
to  the  supervisor,  or  imposed--unt il  compliance  is  gained; 
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to  determine  who  does  what /when  and  set  a  follow-up  date: 
how  to  find  long-term  solutions;  and  how  to  deal  with  emer- 
gent problems.   The  process  involves  extensive  use  of  video- 
taped modules  showing  both  ineffective  and  effective 
behaviors,  structured  role-playing  and  group  discussions. 
The  training  is  given  in  a  series  of  four  one-day  segments, 
one  segment  per  week.   After  each  training  segment,  partici- 
pants "contract"  to  practice  their  skills  during  the  week 
and  to  report  their  results  when  the  class  next  meets. 

B .   PURPOSE 

The  purpose  of  this  thesis  is  to  accomplish  a  portion  of 
the  evaluation  phase  required  by  ISD  [Ref.  2],  and  in 
particular  the  internal  evaluation  of  the  "Problem  Solving 
Skills  for  Managers"  training  package  piloted  by  the  Coast 
Guard  Leadership  School  during  the  period  5  April  1983 
through  2  August  1983.   (The  other  phases  of  the  ISD  process 
in  relation  to  this  training  package  will  not  be  discussed 
in  this  thesis  and  are  assumed  to  have  been  completed  prior 
to  this  stage.)   Internal  evaluation  refers  to  an  analytical 
means  of  measuring  the  instruction  process  by  determining 
student  reaction  or  degree  of  behavioral  change  attributed 
to  the  actual  training- [Ref .  2].   The  instruments  used  to 
measure  the  instruction  process  consist  of  a  series  of  ques- 
tionnaires designed  by  the  developer  of  the  training  process 
The  training  was  conducted  by  a  staff  member  of  the  Coast 
Guard  Leadership  and  Management  School.   The  data  was 
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collected  and  a  computerized  data  base  established  by  the 
leadership  school  staff.   The  purpose  of  this  thesis  is 
to  analyze  the  data  and  make  a  determination  of  the  effec- 
tiveness of  the  training  package. 
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II.   METHODOLOGY 

A.   RESEARCH  SETTING  AND  DESIGN 

The  "Problem  Solving  Skills  for  Managers"  training 
package  was  presented  to  supervisors  at  four  Coast  Guard 
stations  in  the  Twelfth  District  (San  Francisco  area)  as  a 
pilot  program  with  the  goal  of  determining  if  the  training 
should  be  pursued  on  a  larger  scale  within  the  Coast  Guard. 
Two  stations  were  trained  initially  while  the  remaining  two 
stations  were  used  as  a  "control  group."   These  "control 
group"  stations  subsequently  received  the  same  training. 
For  clarity  and  consistency  throughout  this  thesis,  the 
first  group  to  receive  the  training  will  be  referred  to  as 
the  "Early  Treatment  Group"  and  the  second  group  to  receive 
the  training  as  the  "Late  Treatment  Group"  (see  Figure  2.1) 

The  first  portion  of  the  training  design  used  by  the 
Coast  Guard  Leadership  and  Management  School  Project 
Manager /Trainer  is  referred  to  as  a  quasi-experimental, 
non-equivalent  control  group  design  [Ref.  3].   It  involves 
an  experimental  group  and  a  control  group  ("early"  and 
"late"  treatment  groups,  respectively),  both  given  pre-  and 
post-measures.   The  early  group  and  late  group  do  not  have 
pre-experimental  sampling  equivalence.   These  groups  consti- 
tute the  "naturally  assembled  collectives"  of  four  Coast 
Guard  stations,  matched  as  closely  as  possible  for  size 
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(total  numbers  of  people  assigned,  supervisors  and  subordi- 
nates combined)  and  organizational  profile  (operational 
mission,  common  group  commander,  rank  of  those  in  leadership 
positions  within  the  organizational  structure).   That  is, 
the  participants  are  not  randomly  selected  or  assigned  to 
these  groups  as  a  "true"  experimental  design  would  require. 
The  assignment  of  the  treatment  to  one  group  or  another  is 
assumed  to  be  random  and  under  the  researcher's  control. 

The  training  was  conducted  at  each  station  by  the  same 
experienced  instructor  from  the  Coast  Guard  Leadership  and 
Management  School  in  Petaluma,  California.   The  data 
collected  with  the  measurement  instruments  was  transcribed 
by  the  Management  School  staff  to  form  a  raw  computerized 
data  base.   This  researcher  organized  the  data  base  into 
four  files,  one  for  each  type  of  questionnaire,  for  subse- 
quent analysis. 

B.   INSTRUMENTATION 

The  same  pre-measures  and  post-measures  were  given  to 
each  of  the  control  and  experimental  groups,  and  consisted 
of  a  set  of  four  questionnaires  that  were  administered  at 
the  points  in  the  training  design  as  shown  in  Figure  2.1. 
These  questionnaires  were  designed  by  the  company  that 
developed  and  produced  the  training  package. 


1 .  Subordinate  Organization  Survey  (SUBQ) 

This  questionnaire  consists  of  three  parts:   demo- 
graphics; subordinates'  perception  of  organizational 
climate,  satisfaction  and  commitment;  and  subordinates' 
perception  of  their  supervisors'  behavior  in  dealing  with 
problems.   It  was  completed  by  the  subordinates  of  the 
supervisors  who  received  or  were  scheduled  to  receive  the 
training  at  each  of  the  stations.   The  demographic  informa- 
tion section  was  completed  only  at  the  first  administration 
of  this  questionnaire. 

2 .  Supervisory  Organization  Survey  (SUPQ) 

This  questionnaire  also  consists  of  three  parts: 
demographics;  supervisors'  perception  of  organizational 
climate,  satisfaction,  and  commitment;  and  knowledge  of 
problem  solving/organizational  support.   The  supervisors  who 
received  or  were  scheduled  to  receive  the  training  completed 
all  portions  of  this  questionnaire  at  each  administration, 
except  for  the  demographics  section,  which  was  completed 
only  for  the  first  administration. 

3 .  Multiple  Choice  Questionnaire  (MCQ) 

This  questionnaire  was  completed  at  each  administra- 
tion by  each  of  the  supervisors  who  received  or  were  sched- 
uled to  receive  the  training.   It  was  designed  to  measure 
understanding  of  problem  solving  skills  (categorical  and 
episodic  ) . 
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4 .   Supervisory  Evaluation  of  Training  (SETQ) 

This  questionnaire  was  completed  by  supervisors  on 
the  administration  following  completion  of  the  training. 
It  was  designed  to  measure  the  supervisors'  reaction  to  the 
training  program  and  their  motivation  as  determined  by 
intrinsic  factors  (e.g.  recognize  the  positive  natural 
consequences  of  using  the  problem  solving  skills)  and 
extrinsic  factors  (e.g.  organization  support). 

Copies  of  all  four  of  these  instruments  are  included 
as  Appendix  A.   Each  of  these  questionnaires  uses  codes  to 
identify  the  subordinates  and  supervisors  within  the  data 
base  for  cross-referencing  or  comparing  results  based  on 
subordinate  or  supervisor  responses  on  each  variable,  while 
maintaining  the  anonymity  of  the  participants.   The  coding 
of  the  questionnaires  is  explained  in  the  introduction  to 
the  appendix. 

C .   SAMPLE 

The  data  collected  from  these  four  measurement  instru- 
ments was  based  on  a  combined  sample  (N  =  111)  of  subordi- 
nates and  a  combined  sample  (N  =  38)  of  supervisors  who 
received  the  training  at  the  four  stations.   (The  subordi- 
nate sample  size  refers  to  the  number  of  questionnaires 
filled  out  at  each  administration  by  subordinates;  there 
were  actually  a  total  of  52  subordinates,  some  of  whom 
completed  questionnaires  for  more  than  one  supervisor.)   A 
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portion  of  the  supervisors  who  received  the  training  and 
completed  the  Supervisory  Organization  Surveys  were  also 
considered  to  be  subordinates  and  tilled  out  the  Subordinate 
Organization  Surveys  as  well.   These  dual-role  cases  were 
not  identified  in  the  data  base  and  could  not  be  distin- 
guished.  This  could  be  a  source  of  contamination  of  the 
results  noted  in  this  study  and  will  be  discussed  further  in 
chapter  four.   Table  I  shows  the  breakdown  of  supervisors 
and  subordinates  for  each  unit. 


Table  I 

Sample  Sizes  by  Unit  and  Category 

Category 

Unit 

Subordinates       Supervisors 

E300 

035  .             Oil 

E500 

021               007 

C400 

028                011 

C600 

027                009 

Total 

111                038 

Note: 

E  identifies  the  Early  Treatment  Group  and 

C  identifies  the  Late  Treatment  Group. 

Although  the  stations  selected  by  the  Coast  Guard  Project 
Manager /Trainer  were  matched  in  pairs  as  closely  as  possible 
for  size  and  organization  profile,  this  thesis  will  not 
analyze  the  data  obtained  in  terms  of  "matched"  pairs  of 
units.   If  matching  was  to  be  used  as  an  attempt  to 
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compensate  for  the  differences  between  non-equivalent  control 
groups  when  random  assignment  to  experimental  and  control 
conditions  is  not  possible,  it  may  not  only  fail  to  provide 
the  desired  equivalence,  but  in  certain  circumstances  may 
actually  assure  the  presence  of  unwanted  regression  effects 
[Ref.  3].   The  data  samples  will  therefore  be  aggregated  and 
compared  as  early  treatment  vs.  late  treatment  groups. 

D.   PROCEDURE 

A  number  of  hypotheses  regarding  change  as  a  result  of 
the  training  will  be  examined  to  determine  the  effectiveness 
of  this  training  program.   Effectiveness  can  be  evaluated  in 
terms  of  reaction,  learning,  behavioral  and/or  results 
criteria  [Ref.  4].   Each  is  used  to  examine  different 
aspects  of  the  program.   Reaction  criteria  measure  how  well 
the  participants-  liked  the  program.   People  are  more  likely 
to  obtain  maximum  benefit  from  a  program  they  enjoy. 
Reaction,  then,  provides  one  means  of  identifying  reasons 
for  the  success  or  failure  of  a  training  program.   Learning 
refers  to  the  knowledge  and  skills  absorbed  by  the  partici- 
pants.  Behavior  is  the  transfer  of  the  knowledge  and  skill 
to  actual  performance  on  the  job.   Results  criteria  can  be 
cost-related  (lower  cost,  increased  efficiency)  or  behavioral 
(reduced  absenteeism,  attrition,  disciplinary  involvements) 
measures,  which  give  evidence  of  the  training's  impact  on 
organizational  effectiveness.   Because  of  many  complicating 
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factors,  however,  it  is  very  difficult  to  evaluate  in  terms 
of  results  [Ref.  4]. 
1 .   Approach 

This  thesis  will  examine  the  effectiveness  of  the 
training  program  primarily  in  terms  of  learning  and 
behavior . 

a.  Learning 

Learning  will  be  analyzed  in  terms  of  the 
results  of  the  Multiple-Choice  Questionnaire  (MCQ).   Although 
the  Supervisory  Organization  Survey  (third  part)  also  seems 
to  measure  participant  knowledge,  it  appears  to  be  somewhat 
redundant  to  the  MCQ  and  will  not  be  examined  in  this 
analysis.   The  data  base  was  recoded  so  that  the  desired 
answer  received  a  value  of  one  and  all  other  answers  a 
value  of  zero.   A  score  for  each  participant  was  then 
computed  as  a  percentage  correct  of  the  questions  answered. 

b.  Behavior 

Behavior  will  be  analyzed  in  terms  of  the 
results  of  the  Subordinate  Organization  Survey  (SUBQ),  Part 
III.   To  determine  if  any  of  the  fifty  variables  (questions) 
could  be  combined  and  scaled  in  order  to  reduce  the  number 
of  data  comparisons  required,  the  data  from  the  first  admin- 
istration of  SUBQ  Part  III  was  subjected  to  factor  analysis 
using  principal  factoring  with  iteration  and  varimax 
(orthogonal)  rotation.   Nine  factors  were  identified.   Using 
the  Scree  Test  [Ref.  5:   pp.  152-156],  a  plot  of  Eigenvalue 
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vs.  factor  number  (see  Figure  2.2),  it  was  determined  that 
two  factors  were  the  primary  contributors.   The  first  two 
factors  accounted  for  most  (77.3%)  of  the  variance  in  that 
data  set.   Therefore,  a  second  factor  analysis  was  made 
with  only  two  factors  extracted.   The  factor  loadings  from 
the  varimax  rotated  factor  matrix  were  used  to  assign  each 
variable  to  one  of  the  two  factors  based  on  the  weight  of 
the  factor  for  that  variable.   In  reviewing  the  questions 
that  loaded  on  each  factor,  it  appears  that  the  first  factor 
relates  to  "problem  solving  support"  (where  a  high  rating 
indicates  more  support)  and  that  the  second  factor  relates 
to  "passing  the  buck"  with  regard  to  problem  solving  (where  a 
low  rating  indicates  less  "passing  the  buck").   Table  II 
provides  a  listing  of  the  variables  assigned  to  the  first 
factor,  the  corresponding  questionnaire  question  and  the 
appropriate  factor  loading,  in  descending  order  of  factor 
loading.   Table  III  provides  the  same  information  for  the 
second  factor. 

The  values  of  the  variables  included  in  each 
factor  were  then  combined  into  an  average  value  for  each 
subordinate,  so  that  only  two  variables  would  have  to  be 
examined  to  describe  behavior.  A  listing  of  the  means  and 
standard  deviations  of  each  variable  and  the  correlation 
matrix  for  the  input  variables  are  included  in  Appendix  B. 
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Figure  2.2   Scree  Test  for  SUBQ  Part  III  Administration  1 
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Table  II 
SUBQ  Part  III  Factor  One — Problem  Solving  Support 


Variable  Question 

SUBQ1090     Does  your  supervisor  take  action  in  a 
timely  way  to  solve  complaints  you 
bring  to  his  or  her  attention? 

SUBQ117A     Does  your  supervisor  try  to  find  ways 
to  make  the  job  easier  in  the  future? 

SUBQ109J     Is  your  supervisor  supportive  in 

solving  work  related  problems  you  want 
help  with? 

SUBQ109K    Does  your  supervisor  bring  resources 
to  bear  to  help  you  solve  problems 
on  the  job? 

SUBQ114B     To  what  extent  does  your  supervisor 
explain  how  correcting  a  problem 
affects  the  job? 

SUBQ109N     Is  your  supervisor  quick  to  follow 

through  on  problems  you  bring  to  his 
or  her  attention? 

SUBQ109A     Does  your  supervisor  keep  up-to-date 

with  the  problems  you  are  experiencing 
on  the  job? 

SUBQ117B     Is  your  supervisor  concerned  about 
making  the  job  less  difficult  the 
next  time  you  have  to  do  it? 

SUBQ118C    Can  you  be  sure  that  your  supervisor 
will  really  follow  up  to  see  that  the 
problem  is  solved? 

SUBQ110B     To  what  extent  is  your  supervisor  clear 
about  the  facts  of  problems? 


Factor 

Loading 

.81498 


.78898 


.78832 


.78726 


77771 


.76761 


.76639 


.76197 


.75299 


.74615 
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SUBQ114A     When  discussing  a  problem,  to  what        .74586 
extent  does  your  supervisor  clearly 
explain  what  would  go  wrong  with  the 
job  if  the  problem  weren't  corrected? 

SUBQ109C     Does  your  supervisor  take  time  to  ask     .74553 
you  whether  there  are  ways  he  or  she 
can  help  make  your  job  easier? 

SUBQ109B     Does  your  supervisor  take  time  dis-       .73757 
cussing  your  point  of  view  on  your 
work? 

SUBQ118D     Are  you  able  to  trust  that  your  .73488 

supervisor  will  do  what  the  two  of 
you  have  agreed  needs  to  be  done? 

SUBQ112C     Accurately  summarize  your  feelings        .72400 
on  the  matter? 

SUBQ109D     Does  your  supervisor  come  to  your         .69524 
work  area  to  ask  you  whether  you 
need  any  help  to  make  your  job  easier? 

SUBQ116B     To  what  extent  does  your  supervisor       .68101 
show  respect  for  your  ideas  and 
abilities  on  the  job? 

SUBQ116A     To  what  extent  does  your  supervisor       .68007 
treat  you  in  a  way  that  shows  he  or 
she  values  your  experience  and  opinions 
on  the  job? 

SUBQ112B     Demonstrate  by  restating  that  he  or  she   .64727 
fully  understands  the  point  you  are 
tring  to  make? 

SUBQ112D     Carefully  listen  without  arguing  or       .64726 
becoming  upset? 

SUBQ119D     When  dealing  with  an  upset  subordinate,   .64267 
to  what  extent  does  your  supervisor  ask 
the  person  what  is  bothering  him  or  her? 

SUBQ119C     When  dealing  with  an  upset  subordinate,   .63689 
to  what  extent  does  your  supervisor  ask 
what  has  made  the  person  upset  or  angry? 
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SUBQ120B     When  you  have  done  a  good  job,  to         .61350 
what  extent  does  your  supervisor 
express  his  or  her  appreciation 
for  what  you  have  done? 

SUBQ110A     When  your  supervisor  brings  up  a  .57595 

problem,  to  what  extent  is  he  or  she 
clear  about  exactly  what  is  bothering 
him  or  her? 

SUBQ112A     Listen  to  your  point  of  view  without      .54005 
interrupting  or  cutting  you  off? 


Table  III 
SUBQ  Part  III  Factor  Two — Passing  the  Buck 


Variable  Quest  ion 

SUBQ113B     To  what  extent  does  your  supervisor 
"shoot  from  the  hip"  when  solving 
problems  instead  of  stopping  to  learn 
about  the  problem  first? 

SUBQ113C     To  what  extent  does  your  supervisor 
blame  you  for  problems  that  aren't 
your  fault? 

SUBQ111B     To  what  extent  does  your  supervisor 

draw  conclusions  about  you  as  a  person 
when  discussing  problems? 

SUBQ111A     To  what  extent  does  your  supervisor 

put  you  down  when  describing  problems? 

SUBQ115B     When  answering  questions  about  why 

something  must  be  done  a  certain  way, 
to  what  extent  does  your  supervisor 
threaten  you  with  what  might  happen  if 
you  don't  do  what  he  or  she  wants? 

SUBQ109G    Does  your  supervisor  give  you  excuses 

for  not  solving  that  show  you  he  or  she 
won't  "go  to  bat"  for  you? 


Factor 
Loading 

.73719 


.73368 


.72942 


.72151 


.69534 


.68467 


28 


SUBQ109M    Does  your  supervisor  promise  to  see  what 
can  be  done  about  a  problem  but  then 
never  let  you  know  what  he  or  she  did  to 
solve  it? 


.66854 


SUBQ113A     To  what  extent  does  your  supervisor       .66449 
impose  a  solution  to  a  problem  without 
first  stopping  to  figure  out  what  is 
going  on? 

SUBQ113D     When  discussing  a  problem  with  you,  to    .66365 
what  extent  does  your  supervisor  assume 
you're  the  cause  of  the  problem  when 
you're  not? 

SUBQ121A     Does  your  supervisor  act  in  ways  .65113 

that  make  it  hard  to  trust  him  or 
her? 


SUBQ121B    Does  your  supervisor  tell  you  whatever 
he  or  she  thinks  you  want  to  hear  in 
order  to  get  you  to  do  what  he  or  she 
wants? 


.63465 


SUBQ119A     When  dealing  with  an  upset  subordinate,   .62128 
to  what  extent  does  your  supervisor 
get  angry  at  him  or  herself? 

SUBQ115C     When  answering  questions  about  why        .61915 
something  must  be  done  a  certain  way, 
to  what  extent  does  your  supervisor  use 
his  or  her  "stripes"  as  your  supervisor 
to  get  you  to  do  what  he  or  she  wants? 

SUBQ109P     Does  your  supervisor  get  on  your  case     .59848 
too  much  about  little  things  that  are 
not  worth  the  time  they'd  take  to  fix? 

SUBQ118B     Is  it  left  unclear  as  to  who  will  do      .59216 
what  to  solve  the  problem? 

SUBQ120A     When  you  have  done  well  on  the  job,       .56787 
to  what  extent  does  your  supervisor 
express  his  or  her  appreciation  for 
what  you  have  done? 

SUBQ119B     When  dealing  with  an  upset  subordinate,   .56011 
to  what  extent  does  your  supervisor  get 
into  an  argument? 
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SUBQ115A     When  answering  questions  about  why        .55227 
something  must  be  done  a  certain  way , 
to  what  extent  does  your  supervisor 
order  you  to  do  it  the  way  he  or 
she  wants? 

SUBQ118A    Does  your  supervisor  leave  you  guessing   .55187 
about  what  should  happen  next? 

SUBQ109L    Does  your  supervisor  say  he  or  she  will   .55185 
take  action  on  a  problem  but  then  never 
get  back  to  you  to  solve  it? 

SUBQ109I     Does  your  supervisor  refuse  to  take       .53738 
on  the  people  in  power  in  order  to 
remove  complaints  in  your  department? 

SUBQ109F     Does  your  supervisor  fail  to  deal  with    .52699 
problems  before  they  become  severe? 

SUBQ109H     Is  your  supervisor  unwilling  to  argue     .45610 
or  fight  for  you  to  solve  problems 
you  bring  up? 

SUBQ109E     Does  a  problem  have  to  get  out  of  hand    .45293 
before  your  supervisor  chooses  to  deal 
with  it? 


c.   Results 

One  method  of  examining  the  impact  on  organiza- 

2 

tional  effectiveness  is  to  measure  the  subjects   views  on 

organizational  climate,  satisfaction  and  commitment  and  see 
if  they  change  after  training.   The  Subordinate  Organization 
Survey  Part  II  and  the  Supervisory  Organization  Survey  Part 
II  ask  questions  in  these  categories  (see  Appendix  A)  which 
are  similar  to  some  of  the  questions  in  the  related  sections 


"Subjects"  as  used  here  refers  to  both  supervisors  and 
subordinates  who  were  measured  on  these  factors. 
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of  the  Michigan  Survey  of  Organizations  [Ref.  6].   Again,  in 
an  effort  to  determine  the  possibility  of  simplifying  the 
data  base,  the  variables  in  SUBQ  Part  II  Administration  1 
were  subject  to  factor  analysis  using  principal  factoring 
with  iteration  and  varimax  (orthogonal)  rotation.   The 
results  indicated  that  the  questions  relating  to  organiza- 
tional climate  could  be  considered  as  a  single  factor.   For 
satisfaction,  SUBQ107E  (satisfaction  with  pay)  was  not 
related  to  the  other  variables,  so  it  was  not  included  in 
the  scale  for  satisfaction  (the  other  items  accounted  for 
78.7  percent  of  the  variance).   For  commitment,  the  results 
indicated  that  the  three  questions  could  be  considered  one 
factor.   Although  the  scree  test  was  inconclusive,  Guttman's 
procedure  [Ref.  5:   p.  147]  for  estimating  the  lower  bound 
for  the  number  of  factors  suggests  using  the  factors  with 
eigenvalues  greater  than  or  equal  to  1.0,  leading  to  the 
selection  of  one  factor  for  commitment.   The  scree  test 
plots  are  shown  in  Figure  2.3,  Figure  2.4  and  Figure  2.5. 
A  listing  of  the  eigenvalues,  means  and  standard  deviations 
of  each  variable  and  the  correlation  matrix  for  the  input 
variables  are  included  in  Appendix  C.   These  factors  were 
applied  for  each  administration  of  both  SUBQ  Part  II  and 
SUPQ  Part  II.   The  values  of  the  variables  included  in  each 
factor  were  then  combined  into  an  average  value  for  each 
respondent  so  that  only  three  variables  would  have  to  be 
examined  to  describe  "Results." 
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Figure  2.3   Scree  Test  for  Organizational  Climate 
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Figure  2.4   Scree  Test  for  Satisfaction 
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Figure    2.5      Scree    Test    for    Commitment 
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2 .   Hypotheses  to  be  Tested 

Figure  2.6  shows  the  relationships  to  be  examined. 
In  each  case,  the  nail  hypothesis  (Ho)  is  that  there  is  ''no 
change."   Each  hypothesis  will  be  described  in  detail  below. 
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Figure  2.6   Hypotheses  to  be  Tested 

a.   Hypothesis  A 

This  analysis  tests  for  the  effect  of  training 
on  the  "early  treatment  group,"  the  first  set  of  stations  to 
receive  the  training  (see  Figure  2.7). 
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Figure  2.7   Hypothesis  A 


Since  the  early  and  late  treatment  groups  are  non-equivalnet  , 
not  randomly  assigned,  the  difference  in  ratings  on  the 
various  measures  could  be  due  to  a  regression  effect.   A 
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comparison  of  simple  difference  scores  may  therefore  be 
misleading.   What  is  needed  is  to  compare  the  results 
actually  attained  with  the  results  that  would  have  been 
attained  under  the  appropriate  null  hypothesis  of  no  treat- 
ment effect  [Ref.  7:   p.  25].   To  account  for  this,  a  method 
of  estimating  the  no-treatment  result  for  the  experimental 
(early  treatment)  group  will  be  used.   The  results  of 
the  late  treatment  group's  second  administration  of  the 
questionnaire  of  interest  will  be  regressed  on  the  results 
of  the  late  treatment  group's  first  administration,  producing 
a  constant  and  an  unstandardized  regression  coefficient. 
These  values  will  be  applied  to  the  actual  results  of  the 
first  administration  for  both  the  early  and  late  treatment 
groups  to  obtain  a  predicted  value  for  the  second  administra- 
tion.  These  predicted  values  will  then  be  subtracted  from 
the  actual  values  to  obtain  the  difference  or  residual 
values.   These  residual  values  will  then  be  compared  between 
the  late  and  early  treatment  groups  by  means  of  a  t-test. 
Hypothesis  A  can  be  broken  down  into  analyses 
between  the  late  and  early  treatment  groups  for  SUBQ  Part  III 
Factor  One,  SUBQ  Part  III  Factor  Two,  SUBQ  Part  II  Factor 
One,  SUBQ  Part  II  Factor  Two,  SUBQ  Part  II  Factor  Three, 
SUPQ  Part  II  Factor  One,  SUPQ  Part  II  Factor  Two,  and  SUPQ 
Part  II  Factor  Three.   These  comparisons  and  the  statistical 
techniques  used  are  summarized  in  Table  IV. 
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TABLE    IV 
Sub-Hypotheses    for    H(A) 


i 


\T    ,,1      - 

Hypothesis: 


Nc    ch  a  p.  a  s    b et  w  3 3  a 

— o  _  j.  /         a.  ii  u 

"late"    arouDs    for 


Method    of 
Analysis 


H(A1) 

H(A2) 
H(A3) 
H  (A  4) 
H  (A5) 


H  (A6) 
H  (A7) 


H  (A3) 
H  (A9) 


Subordinate  perception 
of  Supervisor  'Problem 
Solving   Support'. 


Subordinate    Perception 

of    Supervisor    "Passing 
the    Buck". 
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residuals    and 
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residuals. 


Supervisor 

Commitment 
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b.  Hypothesis  B 

This  analysis  tests  for  the  effect  of  training 
on  the  "late  treatment  group,"  the  second  set  of  stations  to 
receive  the  training  (see  Figure  2.8). 

e  .©    »    ©  ©   © 

l    ©        ©    „'     ©  © 

Figure  2.8   Hypothesis  B 

In  this  situation,  the  regression  effect  is  assumed  to  have 
taken  place  between  the  first  and  second  administration 
[Ref.  8].   Hypothesis  B  can  be  broken  down  into  analyses  of 
the  same  variables  as  Hypothesis  A,  but  comparing  between 
administration  2  and  administration  3  for  the  "late  treat- 
ment group."   These  comparisons  are  summarized  in  Table  V. 

c.  Hypothesis  C 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  "early  treatment  groups,"  between  the 
first  two  administrations  after  training  (administration  2 
and  administration  3),  as  shown  in  Figure  2.9. 
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TABLE    V 
Sub-Hypotheses    for    H(B) 


Null 

H ypothes is: 


So  change  between 
administrations  2 
and   3   of    "laze" 

group    for: 


Method    o: 

Analysis 


H(B1) 


Subordinate  perception 
of  Supervisor  'Problim 
Solving  Support'. 


H  (B2) 


H  (E3) 

H  (BU) 


H  (B5) 


H  (B6) 
H(B7) 


H  (B8) 
H  (B9) 


Subordinate  Percep-ion 
of  Supervisor  "Passing 
the    Buck". 


Hulti  pie-cho  ic< 
Quesr icnnair e 

score 


Subordinate    Perception 

of  Organization 
c  lima*  a. 


Sub or  dinate 
Satis  fac~ ion 


S  ub or dinate 
Commitment 


Supervisory    Perception 
o f  Or ganizat ion 
ciima  te. 


S  uper  viscr 
Satis  faction 


S  uper visor 
Commi tmen- 


T-Test : 
Comparison 
of    actual 
ratings  ' 
means 
between 
Admin.     2    and 
Admin.     3    for 
the    "Late" 
tr  ea.m ent 
groups  . 
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L     ©         ©      x     ©    © 

Figure  2.9   Hypothesis  C 

This  analysis  also  assumes  that  the  regression  effect  has 
taken  place  between  the  first  and  second  administrations. 
Hypothesis  C  can  be  broken  down  into  analyses  of  the  same 
variables  as  Hypothesis  B;  these  comparisons  are  summarized 
in  Table  VI. 

d.   Hypothesis  D 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  "early  treatment  groups,"  between  the 
last  two  administrations  after  training  (administration  3 
and  administration  4),  as  shown  in  Figure  2.10. 


©    «    © 
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Figure  2.10   Hypothesis  D 
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TABLE    71 
Sub-Hypothesss    foe    H(C) 


Null 

Hy pot hes is: 


No  change  between 
a d minis'  rations  2 
and  3    ("early" 

group)    for: 


Method    o 

Analysis 


H  (C1) 


Subordina-e    perception 

of   Supervisor    'Problem 
Solving   Support1. 


H(C2) 
d{C3) 
H  (C4) 

H(C5) 

H  (C6) 
H  (C7) 

H  ( C8 ) 
H  (C9) 


Subordinate    Perception 

of  Supervisor   "Passing 
the    Suck". 

M  ulr.iple-cb.oice 
Quest,  lonnair  e 
s  co  r  e 

Subordinate    Perce pti or. 
of  Organization 
climate. 


Subordinate 
5  acis  fact  ion 

Subor  dinate 
Com mi tmer.t 

Supervisory    Perception 
of  Organization 
climate. 

S  uper visor 
S  atrsiaction 


S uper  visor 
Commitment 


Comparison 
of    actual 
ratings' 
means 
betw  een 
Admin.    2    and 
Admin.    3    for 
the   "early" 
tr  eatmen t 
groups. 
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This  analysis  also  assumes  that  the  regression  effect  has 
already  taken  place.   Hypothesis  D  can  be  broken  down  into 
analyses  of  the  same  variables  as  Hypothesis  C;  these 
comparisons  are  summarized  in  Table  VII. 
e.   Hypothesis  E 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  "late  treatment  groups,"  between  the 
last  two  administrations  after  training  (administration  3 
and  administration  4),  as  shown  in  Figure  2.11. 

e    ©    »    ©  ©   © 

L     ©         ©      «     ©_,£) 

Figure  2.11   Hypothesis  E 

This  analysis  also  assumes  that  the  regression  effect 
has  already  taken  place.   Hypothesis  E  can  be  broken  down 
into  analyses  of  the  same  variables  as  Hypothesis  D;  these 
comparisons  are  summarized  in  Table  VIII. 
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TABLE    VII 
Sub-Hypot heses    for    H(D) 


Null  Nc   chants    between  Hsthod    o: 

Hypothesis:  administrations   3  Analysis 

and   4    ("early" 

group)    for: 

H(D1)  Subordinate    percaption 

of   Supervisor    'Problem 
Solving   Support'. 

H  (D2)  Subordinate    Perception 

of   Supervisor    "Passing 
the    Buck". 


'—  T  =  «■ 


H  (D3)  Multiple-cho ice 

Questionnaire  Comparison 

Score  of    actual 

. ratings' 

H(D4)       Subordinate  Perception  means  between, 

of  Organization  Admin.  3  and 

climate.  Admin.  4  for 

the  "early" 

treat  men-. 
H  (D5)        Subordinate  groups. 

Satisfaction 

a  (D6)        Subordinate 
Commi  tment 

H7"E*7]        5"upef  visory  "Perception 
c  f  Or ganizat ion 
clima  te. 

H (D8)  S  uper visor 

Satis  faction 

H  (D9)  Ccumitme  nt 
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Mull 

i      H ypcthes is: 


H  (E1) 


H  (E2) 


H  (E4) 

a  (E5) 

H  (E6) 


H(E7) 


H  (E8) 
H  (E9) 


TABLE    VIII 
Sub-Hypotheses    for    H(E) 


No  char.g  e  bet  wean 
admi1"  is-  ra*  ions  3 
and   a    ("late" 


group) 


or: 


Subordinate    perception 

of   Sucfrvisor    'Problem 
Solving  SupDor"-:  •  . 


Subordinate  Perception 
of  Sup<=i~visor  "  Pa  ^ s i ",  3 
the    Buck "7 


H  (E3) 

Multiple-cho  ics 
Q  uest  icnnair  e 
score 

Subordinate    Perceptio: 

of  Organization 
c  li  m  a  -  e . 


Sub or  din a te 
Satisfaction 


Subordinate 
Commitment 


Supervisory    Perception 
of  Organization 
clima  re. 


S  UDar  visor 
Satis  fact  ion 


Supervisor 

Ccmmi  tment 


Method    cf 
analysis 


r-Test : 
Comparison 
of   actual 
rat*  p  cr  s ' 
means 
between 
Admin.     3    and 
Admin.     4    for 
"late" 
tr ear men- 
group  3  . 
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III.   RESULTS 

A.   REGRESSION  RESULTS 

The  study  of  the  effect  of  the  training  on  the  early 
treatment  groups  was  based  on  a  comparison  of  the  residuals 
developed  from  the  regression  analysis  procedure  discussed 
in  chapter  two.   The  regression  analysis  provided  the  values 
for  the  coefficient  "b"  (slope)  and  the  constant  "a"  (inter- 
cept) in  the  regression  equation  for  each  sub-hypothesis 
described  in  chapter  two.   In  addition,  analysis  of  variance 
provides  an  "F-ratio"  which  describes  the  strength  of  any 
linear  relationship  between  administration  one  and  adminis- 
tration two  for  the  sub-hypotheses  of  interest  (for  the  early 
treatment  groups).   Table  IX  provides  a  summary, of  these 
values.   The  null  hypothesis  is  that  the  slope  =  0,  that 
there  is  no  relationship.   A  statistically  significant  rela- 
tionship justifies  using  the  regression  procedure.   Except 
for  "subordinate  perception  of  supervisor  'passing  the  buck'" 
and  "Multiple-Choice  Questionnaire  Score,"  a  signifi- 
cant linear  relationship  is  shown  for  each  sub-hypothesis. 
For  the  non-significant  items,  a  t-test  can  be  used  to 
determine  if  any  differences  exist  between  the  early  and 
late  treatment  groups'  actual  ratings  on  these  items. 


45 


X 
H 

W 

F-t 


W 
■M 
H 

W 
<B 

03 

W 
•H 
W 

>i 
iH 

id 
a 

<c 

a 
o 
•h 
w 
w 

Q) 
M 

0) 

05 


n-4 


© 

co 


Cu 


42 


o 

•H 

4-> 

a. 

■H 

M 
0 

CO 
<D 

a 


CO 
0) 

4- 
o 

>1 

CO 


r^      i 

r-»      i 

CO    1 

kO 

VO  1 

CC    1 

CO   1 

a-      i 

■K-           1 

r—    ( 
•8-     1 

=t  1 

CT    1 

vO   1 

^■"  i 

©  1 

o 

CO          1 

m  i 

er 

O   i 

00 

<N 

©        1 

CN        1 

r- 

O  I 

O   1 

o 

in  i 

f— 

t-"   | 

O        | 

m      ) 

CO   1 

o 

©  1 

©  1 

©  i 

O  1 

©   1 

© 

T— 

CO   1 

©  1 

O    1 

©  1 

O   1 

o 

©   1 

t 

• 

•    1 

ff 

t 

©  1 

t 

• 

O   1 

o 

o 

o 

© 

©  1 

•    1 

© 

© 

o 

t  ) 
©   1 

m 

r- 

r-  i 

rn 

m 

ID 

,-r 

cn 

3"          1 

©   1 

*• 

ro  1 

CTi 

r+ 

CM 

in  i 

CN        | 

r» 

CN   1 

© 

r» 

ro 

St 

»— 

r-   | 

r-      i 

cr 

CN   1 

r- 

m 

CN 

CN   1 

r^ 

o>  1 

CTi         ( 

T         1 

o 

oo 

o 

P- 

O*' 

cr- 

(r*f    | 

•                   1 

i 

• 

• 

t 

r 

t 

t 

m  i 

o 

CN         1 

o 

a-  i 

in  i 

• 

CTl 

=r 

•   1 

CN         I 

CN 

m 

CN 

f^ 

CN   1 

LP 

r^      i 

un 

r- 

co 

in 

\£> 

CN         I 

oc 

vC 

O 

n 

m 

r*~ 

^ 

cr  I 

e'- 

lO 

r» 

O 

© 

CN 

4* 

CO 

o>  1 

er 

CO         1 

CO 

r^ 

in 

© 

CN 

© 

in  i 

m 

x— 

o 

© 

3- 

r* 

in 

vO 

cr  i 

> 

• 

t 

9 

• 

.-o 

• 

• 

r*  i 

o 

o 

1 

o 

© 

o 

© 

o 

t  i 
©  i 

LO 

CO 

rn 

CO 

(T» 

m 

^, 

in 

I"» 

vO 

CN 

CO 

=t 

=r 

«■" 

r-  i 

lO 

in 

r- 

CN 

r- 

C3> 

r- 

en 

r"  | 

ao 

\D 

CN 

vO 

r- 

O^ 

=y 

^O 

in  i 

T— 

*■ 

CT 

© 

^o 

CTi 

en 

=r 

T—     | 

• 

■ 

t 

t 

t 

in 

* 

t 

r—    | 

m 

no 

o 

CN 

rj 

■ 

CN 

" 

^* 

•    1 

Cr 

14-1  > 

M-J 

H-l 

OrH 

o  a; 

O 

a 

m 

o 

j=: 

0' 

o 

o  o> 

c 

ceo 

c+j 

C+J 

•H 

+-> 

+-' 

1  o 

o 

0 

O  id 

-p 

C 

c  id 

•  H 

+     1 

■h  e 

■H  en 

a 

•H  S 

u 

0' 

o  s 

M 

1    £  1 

-»•>  i) 

4->  C 

u 

-M-.  t 

id 

e 

H-r-f 

U 

1    0'  1 

CUH 

cuh 

o 

cwh 

H-l 

V 

1    4->rH 

CO 

1    £   1 

cr.n 

CD  CO 

u 

<DU 

1    W 

•H 

1    CU.J 

1  <4-l 

1   -P  1 

uo 

u  w 

OT 

o 

1  -H 

S 

1    G' 

CO 

1  -H   1 

MH 

u  td 

0) 

M.H 

1   -4' 

e 

UrH 

1  -H 

1    B   1 

uioi 

u>cu 

U  ci> 

0)  id 

1    rC 

o 

1    U  (0 

1    4-> 

C=      l 

p-> 

fos 

•H  H 

Ch  c 

CO 

o 

1    T)  Cj 

I  (d 

O  1 

OH 

o 

1  Oj  O 

CO 

I  U  1 

<VM 

a>  m 

rC     f0 

1    OJ-H 

Q) 

a; 

1       -H 

4->  O 

1    4JO 

u  c 

1  4->4-> 

1    +-1 

i  ■*-' 

1    M-P 

1      1-4 

1    M  1 

(0  w- 

<d  co 

1   1  a 

(0   <Tl 

I    <tl 

i  (n 

1    O  id 

1   o 

1    O  1 

C-H+J 

C-H 

1    0'  o 

i  a  n 

1    C 

i  a. 

1    V)  N 

1    CO 

1    IS)  I 

•H  >  M 

•H  > 

rH-H 

•H-r-l 

1  -H 

1  -H 

1  -H-H 

1  -H 

1  -H  1 

13  t-i  O 

1  t3  Mr 

a#fj 

i  T3  e 

1  T3 

1  fQ 

1    >  C 

1  > 

1    >   1 

Md'a 

i  u  (T.*: 

1  -H  '0 

i   M  id 

1     n 

1    M 

1    t-i  <tf 

1     (-4 

1    U  1 

O  CLQ* 

1    O  CUO 

1   +J  (U 

1    O  Pn 

1  o 

1    O 

i   ai  en 

1  (1) 

i   a'  i 

£33 

1^33 

i  H  a 

1  X3  U 

1  X5 

i  -a 

1    QjM 

1    CL 

1    CX| 

3  CO  CO 

1    3C0C0 

1    3  0 

1    30 

1    3 

1    3 

1    30 

1    3 

1    3   1 

CO 

1    CO 

1   S 

CO 

1   CO 

1   CO 

1   CO 

CO 

1    CO   | 

- 

1    CN 

1  m 

1   3- 

i  m 

1  '-O 

i  r^ 

1  © 

1  ©  1 

(-i 


CO 

i  o 

U4'  t 
Cn  s 
.-»  (0  c 

m  wa 

(it  CD 
d->l4-j  (1) 
pC  Q)  l-i 
+->  M^ 

•i-l     .  O 

© 
<1>-H  CO 

O_00  'i; 

o=  a? 

T3  1(313 


O 

4-' 

CO 

0' 


id  c 

•H 
-P  f J 

O.IT3 
(')  l-i 
U  I 
!  4Ct<4-l 
(t)  1> 
-M  0)  U 
«J3 

•H+-r 

• 

0>  OU-4 
^-P     • 
-P      13 
or 

O  H 
+j  <D 

<4-l     . 

4-1        4-4 

0)=   o 

r  a> 
r       0 

r  •  (ft 
C  U 
it3  O"-* 
C-HU-4 
ata-'-H 
CO  C 

r   3  © 

(d  CT'H 

raw 


© 
© 


0) 

4-' 

3t 

O 

rH 
<l> 

C 
lO 

U 


•H 
C 
© 


4J 

o 

£3 


4- 

•H 


C 
O 


-C 
4-> 

CO 
0) 
4-> 

(d 
u 

•H 
TJ 
C 
•H 


L_. 


46 


B.   HYPOTHESIS  A 

The  first  hypothesis  examined  was  the  null  hypothesis  of 
no  training  effect  on  the  early  treatment  group,  as  deter- 
mined by  a  t-test  between  the  residuals  of  the  ratings  for 
the  early  treatment  group  and  the  late  treatment  group  at 
administration  two.   See  Figure  3.1. 

E     ©     *     ©>,         ©    © 

________________  _______  ______  _>____  __  ______________ __ 

"•     ©  ©^     x      ©    © 

Figure  3.1   Hypothesis  A 

The  results  of  these  tests  are  shown  in  Table  X.   The  column 
labeled  "means"  refers  to  the' mean  value  of  the  differences 
between  the  actual  and  predicted  scores  (difference,  or 
residual,  equals  the  actual  score  minus  its  predicted  score) 
This  difference  is  negative  if  the  actual  score  is  less  than 
the  predicted  score.   When  this  happens  for  the  group  that 
received  the  training,  it  indicates  that  the  training  has 
caused  a  reduction  in  the  score  used  in  the  test  of  the 
sub-hypothesis.   If  the  difference  is  positive,  it  indicates 
that  the  training  has  caused  an  increase  in  the  score.   For 
those  items  showing  a  significant  linear  relationship  for 
the  late  treatment  group  between  administration  one  and 
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TABLE    X 
Residuals    I-Test  Results 


Null    Hypothesis: 
Nc    chanjs    between 
"early"   and 
"late"   groups    fcr: 


Means: 

Earl^        T-        d.f.       2-tail 
— --    Value  Prcb. 


H(A1)      Subordinate   oer- 

ception    of  Super-      -0.2452 

visor    '  Pr  cblarn 

Solving    Support1  0.03  3  3 


-1.6 


QO 


11  0 


H  (A2) 


Sub 
cep 
vis 
the 


ordinate  Per- 

tion    of  Super-      -3.0552 

Buc!c"~  0.0333 


-0.29       92 


769 


H(A3) 


Mul 
Que 

SCO 


t  iple-  choic; 
stionn  aire 


0.  1949 

0.0030 


2.73       35 


.  010* 


H  (AU)      Subordinate  Per- 
ception   of  -0.3527 
Organ  izat  ional 
Climate  0.0330 


-2.3 


91 


.  022- 


H  (A5) 

Subordinate 
Satis  fact  icr. 

-3.338  1 

-2.27 
3.0030 

91 

.325* 

H  (A6) 

Subordinate 
Commitment 

-0.3223 

-1.88 
0.0330 

68.45 

.064* 

H(A7)       Supervisor  Per- 
ceo- ion    of 

Oraanizat  icnal 
Climate 


0.  1132 
0.0333 


0.44       35 


.666 


H  (A8)       Supervisor 

Satis  fact  ion 


3.231  1 
0.0000 


1.08       35 


.  289 


H  (A9)       Suo  =  r  visor 
Commi tme  nt 


-0.2248 
0.0333 


-0.84       3  5.90     ."07 


Note:       "d.f."    refers   to    degrees   of    freedom.      T-Value 
refers   to    the    student   t-statistic. 
*   identifies   the    most   significant    items. 
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administration  two,  as  discussed  in  the  previous  section,  a 
comparison  of  the  difference,  or  residual,  means  between  the 
early  and  late  treatment  groups  provides  a  measure  of  the 
significance  of  any  changes  noted.   Table  X  shows  the 
results  of  these  comparisons.   For  those  items  not  showing  a 
significant  linear  relationship  for  the  late  treatment  group 
between  administration  one  and  administration  two,  a  compar- 
ison of  the  actual  scores  (for  example,  using  a  t-test  )  is 
appropriate.   Table  XI  provides  the  t-test  results  for  these 
items,  as  well  as  t-test  results  for  the  other  sub-hypotheses 
for  comparison  with  the  regression  results. 

As  shown  in  Table  X,  sub-hypotheses  3,  4,  5  and  6  indi- 
cate significance  at  least  at  the  .065  level.   Multiple-Choice 
Questionnaire  Scores  are  above  the  predicted  scores  for  the 
early  treatment  group,  indicating  that  training  had  a  posi- 
tive impact  on  supervisors'  knowledge  of  the  problem  solving 
process.   (As  would  be  expected,  because  the  linear  rela- 
tionship between  administration  one  and  administration  two 
for  the  late  treatment  groups'  Multiple-Choice  Questionnaire 
Scores  was  not  significant,  the  t-test  on  the  actual  scores 
provided  similar  results.   See  Table  XI.)   Subordinate 
perception  of  organizational  climate,  satisfaction  and 
commitment  all  show  a  significant  decrease  for  the  early 
treatment  group  (p  >  .065),  indicating  that  the  training  had 
a  negative  impact  on  these  ratings. 
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TABLE    XI 
&ctual-Score   I— test   Results 

Null   Hypothesis:  Means: 

No    change   between  I-  o.f.       2-tail 

"early"    and  Early        Value  Prcb. 

"late*   groups    for  - 

2  m  m  1.3  u  it  a~  i  o  n  2  Las 

H{A1)      Subordinate   oer- 

ception    of   Super-        4.50  3  0 

visor    'Problem  -1.58      92  .118 

Solving    Support'  4.7832 

H(A2)      Subordinate  Per- 
ception   of   Super-         2.6333 

visor    "Passing  -0.23      92  .822 

tha    Buck"  2.73  2  4 

H  (A 3 )       Hul t i pi e- cho ice  0.5920 

Questionnaire  2.72      35  .010* 

score  0.399  9 

H(A4)       Subordinate   Psr- 

ception   of  4.03  7  3 

Organizational  -2.47      92  .015* 

Climate  4.4747 

H(A5)       Subordinate  4.3445 

Satisfaction  -3.26      38.40    .002* 

4.9125 

H(A6)       Subordinate  3.5435 

Commitment  -2.41       30.19     .018* 

3.9653 

H(A7)       Supervisor  Per- 
ception   of  4.1642 

Organizational  0.26      35  .797 

Climate  4.0327 

H  (A8)       Supervisor  4.8776 

Satisfaction  0.81       27.7  1    .426 

4.6526 

H(A9)       Supervisor  3.7222 

Commitment  -2.39       35  .022* 

4. 5439 

Note:       "d.f."    refers   to    dearees   of    freedom.      T-Value 
refers   to    the    student   t-statistic. 
*   identifies  the    most    significant    items. 


50 


C.  HYPOTHESIS  B 

The  second  hypothesis  examined  is  the  null  hypothesis  of 
no  treatment  effect  on  the  late  treatment  group,  as  deter- 
mined by  a  t-test  on  the  ratings  between  administration  two 
(immediately  before  the  training)  and  administration  three 
(immediately  after  the  training).   See  Figure  3.2. 

e    ©    »    ©  ©   © 

L    ©        Q    .,;     ©  © 

Figure  3.2   Hypothesis  B 

The  results  of  these  tests  are  shown  in  Table  XII.  In  this 
and  the  remaining  tables,  "means"  refers  to  the  means  of  the 
actual  scores  or  ratings.  Most  of  the  means  show  the  appro- 
priate trends,  but  none  except  Multiple-Choice  Questionnaire 
Score  are  significant  below  the  .124  level.  Multiple-Choice 
Questionnaire  Score  is  the  most  significant  (p  >  .087). 

D.  HYPOTHESIS  C 

The  third  hypothesis  examined  is  the  null  hypothesis  of 
no  longitudinal  change  in  the  ratings  for  the  early  treat- 
ment group  for  the  two  administrations  immediately  following 
training  (administrations  two  and  three).   See  Figure  3.3. 
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Table    XII 
T-Test    Results     for    Sub-Hypotheses    of    H(B) 


Null   Hypothesis: 
No   change   between 
a  d  si  i  r.  i  s  t  r  ?  t  i,  o  n  2 
and    administra- 
tion   3    for   the 
"late"   groups 


Admin 

2 

X. 

V  a  1  U 

Admin 
3 

<£  ~   -a 

.c'  _  C  3 


H(31)      Subordinate  oer- 

ception    of  Super-        4.74  9  1 

viso  r    ' Pr  oblam 

Solving    Support'  5.0010 


-1.55     102 


.  124 


H  (B2)       Subordinate   Pe: 
caption    of   Suo; 
visor    "Passing 
tha    Buck" 


2.7S1  1 
2.5942 


0.90     102 


369 


H  (B3)       Multiple- choice  39.992  6 

Questionnaire 

score  52.7415 


-1.76       36 


037* 


H(34)       Subordinate  Pel 
cepticn    of 
Organizational 
Climata 


4.4533 
4.4203 


0.19     102 


.  346 


H  (B5)       Subordinate 
Sat  is  fact  io: 


4.6731 
4.9654 


-0.56       96.95    .577 


H  (B6)       Subordinate 
Commitment 


3.9551 
3.9487 


0.04       92.35    .963 


H  (B7)       Supervisor  Per- 
ception   of 
Organ izat  icnal 


4.0327 


-0.5i 


36 


579 


Climate 

4.2770 

H  (38) 

Supervisor 
Satis  faction 

4 .6526 
4 .6525 

0.0 

35 

1.0  0 

H  (B9) 

Supervisor 

Commitment 

4.5439 
4.455  1 

0.27 

36 

.792 

Note:       "d.f."    refers   tc    degrees   of    freedom.      T-Value 
refers   to    the   student   t-statistic. 

*    identifies  the    most    significant    items. 
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Figure  3.3   Hypothesis  C 

This  analysis  determined  whether  the  after-training  scores 
either  declined  or  increased  over  time,  and  the  significance 
of  any  differences.   The  results  of  this  analysis  are  shown 
in  Table  XIII.   The  most  significant  difference  is  for 
sub-hypothesis  six,  subordinate  commitment,  which  has 
increased  from  administration  two  to  administration  three 
(p  >  .172). 

E.   HYPOTHESIS  D 

The  fourth  hypothesis  examined  is  the  null  hypothesis  of 
no  longitudinal  change  in  the  after-training  ratings  for  the 
early  treatment  group  for  administrations  three  and  four. 
See  Figure  3.4. 
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Figure  3.4   Hypothesis  D 
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Table  XIII 
T-Test  Results  for  Sub-Hypotheses  of  K(C) 


Mull   Hypothesis: 
No   change   between 
administrations 
2   an  i   3    for    t  he 
"early"    groups 


Means' 

Admin 

2 


;_  -  -a  -    i 


Value 


H(C1)      Subordinate  per- 
ception   of   Super- 
vise r    ' ?r  obi sm 
Solving    Support1 


a  .4332 
£4.5693 


-.5a       99 


.  592 


H  (C2)       Subordinate   Per- 
ception   of   Super-         2.7342 
visor    "Passina 
the    Buck"  2.7117 


-.04       92.59    .970 


H  (C3)       Multiple-choice  53.2023 

Questionnaire 

score  58.3235 


0.05       33 


gSR 


H  (C4)       Subordinate  Pel 
ceo-ion    of 
Organ  izan  icnal 
Clim ate 


4.051 8 
3.9099 


1.0'0       99 


320 


H(C5) 

Subor  dinate 
Sat  is  fact  ion 

4.3539 
4  .4950 

-0.90 

99 

.372 

H  (C  6 ) 

Subordinate 
Commitment 

3.4379 
3.720  0 

•1  .  38 

99 

.17  2* 

H  (C7)      Supervisor  Per- 
ception   of 
Organizat  ional 
Climate 


4.  1642 
3.9346 


0.65       29.31    .520 


H  (C8)      Supervisor 

Satis  fact  icn 


4.8738 
4  .6557 


0.71       20.89     .485 


H(C9)       Supervisor 
Commitment 


3.7222 
3.7778 


-.16       31  .875 


Note : 


"d.f."    refers   to    degrees    of    freedom.      r-Value 

refers   to    the  student   t-statistic. 

*    identifies  the    most    significant    items. 
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This  analysis  determined  whether  the  after-training  scores 
either  declined  or  increased  over  time,  and  the  significance 
of  any  differences.   The  results  of  this  analysis  are  shown 
in  Table  XIV.   The  most  significant  result  (p  >  .211)  is  for 
sub-hypothesis  nine,  supervisor  commitment,  which  increased 
from  administration  three  to  administration  four. 

F.   HYPOTHESIS  E 

The  fifth  hypothesis  examined  is  the  null  hypothesis  of 
no  longitudinal  change  in  the  ratings  for  the  late  treatment 
group  between  the  last  two  administrations  following  the 
training  (administrations  three  and  four).   See  Figure  3.5. 


«      ©     «     ©  ©    © 

L   ©      ©    '    ©_JP 

Figure  3.5   Hypothesis  E 

This  analysis  used  the  same  methodology  as  used  for 
Hypothesis  D.   The  results  are  shown  in  Table  XV.   The  most 
significant  result  is  for  sub-hypothesis  six,  subordinate 
commitment  (p  >  .113),  which  has  increased  from  administra- 
tion three  to  administration  four. 
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Table    XIV 
T-Test    Results    for    Sub-Hypotheses   of    H(D) 


Null   Hypothesis: 
No   change   between 
administrations 

3    cr.d  u    for    t  he 
"early11    groups 


Mea: 

l3  '. 

Aim: 

..1 

i 

Value 


Pro; 


H(D1)       Subordinate    o^r- 

csption    of  Super-        4.5693 

vise  r    '  Prcblem 

Solving    Support1  4.554  0 


0.06       84.26    .937 


H(D2)       Subordinate   Per- 

ception    of  Super-        2.7117 

visor   "Passing 

ths    Buck"  2.4675 


1.09       95 


.277 


H(D3)       Multiple- choice  58.923  5 

Quest lonn air  s 
score  55.4701 


0.51       33 


.613 


H(D4)       Subordinate  Pei 
ception    of 
Organ  izat  ional 
Climate 


H(D7) 


3.9039 
3 . 329  8 


0.53       95 


.601 


H  (D5) 

Subordinate 
Satis  fact  icn 

4  .4950 
4.551  1 

-.28 

95 

.733 

H  (D6) 

Subordinate 
Commitment 

3.7230 
3.7943 

-.34 

95 

.737 

Supervisor  Per 
ception    of 
Organizational 


3. 9  34  6 


-.38       25.91     .703 


Climate 

4.  1073 

H  (D8) 

Supervisor 

Satis  fact  icn 

4.6557 

4. 7389 

-.33 

31 

.742 

H  (D9) 

Supervise  r 
Commitment 

3.7778 

4.3148 

-1.  28 

31 

.211* 

Note: 


"d.f."    refers   to    degrees   of    freedom.      I-Value 

refers   to    the    student    t-statistic. 

*   identifies  the    most    significant    items. 
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Table   XV 
T-Test    Results    for    Sub-Hypotheses    of    H(E) 

Null   Hypothesis:  Heans: 

No   change   between  admin        I-  a.f.       2-t~ii 

administrations  3  Vain-  Prcb. 

3   and  U    for   the  

"late"    groups  '4 

H(E1)      Subordinate   oer- 

csd4. ion    cr   Suo=r-        5. 03 10 

visor    'Problem  1.16    101  ,248 

Solving    Support'  4.814  2 

H(E2)       Subordinate   Per- 
ception   of   Super-        2.5942 

visor    "Passing  0.37    131  .714 

the    Buck"  2.514  0 

H(E3)      Multiple- choice  52.7415 

Questionnaire  3.33      36  .708 

score  49.9325 

H  (E4)       Subordinate  Per- 
ception   of  4.4203 

Organizational'  1.11    101  .270 

Climate  4.2259 

H(E5)      Subordinate  4.9554 

Satisfaction  0.6  8    101  .496 

4.8527 

H(E6)     'subordinate  3.9437- 

Commitment  -1.60    101  .113* 

4.2222 

H  (E7)      Supervisor  Per- 
ception   of  4.2770 

Organizational  -.36      36  .718 

Climate  4.413  5 

H(E8)       Supervisor  4.6526 

Satisfaction  -.73       36  .471 

4.9053 

H  (S9)       Suoervisor  4.4551 

Commitment  -.71       36  .484 

4.6657 


Note : 


"d.f,"    refers   to    degrees    of    freedom.      r-Valu 

refers   to    the   student   t-statistic. 

*    identifies  the    most   significant   items. 
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IV.   DISCUSSION 

A.   INTRODUCTION 

As  mentioned  in  chapter  two,  the  first  portion  of  the 
research  design  developed  for  this  project  is  described  by 
Campbell's  and  Stanley's  Design  10  [Ref.  3:   pp.  46-50],  a 
quasi-experimental  non-equivalent  control  group  design, 
which  they  state  is  one  of  the  most  widespread  experimental 
designs  in  education  research.   The  more  the  experimental 
and  control  groups  are  similar  in  their  recruitment  and  the 
more  this  similarity  is  confirmed  by  scores  on  a  pre- 
measure ,  the  more  effective  this  design  is  in  controlling 
for  the  main  effects  of  history,  maturation,  testing  and 
instrumentation.   One  area  of  concern  in  this  design  is  that 
of  intrasession  history.   Since  all  of  the  subjects  in  each 
of  the  experimental  groups  are  measured  in  two  separate 
sessions,  and  the  same  for  the  control  groups,  the  irrele- 
vant unique  events  in  any  of  these  sessions  become  rival 
hypotheses  for  explaining  any  pre-measure/post-measure 
differences  for  the  two  early  treatment  groups,  the  two  late 
treatment  groups  or  between  the  combined  "early"  groups  and 
the  combined  "late"  groups.   Another  major  concern  affecting 
internal  validity  is  that  of  interaction  effects  of  selec- 
tion and  such  extraneous  factors  as  history,  maturation  and 
testing.   In  general,  these  interactions  are  unlikely,  but 
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must  be  considered  in  the  analysis.   Regression  can  provide 
another  source  of  internal  validity  problems  in  this  design, 
especially  if  a  matching  procedure  is  used  that  results  in 
substantially  different  group  means. 

B.   INSTRUMENTATION 

Four  sets  of  questionnaires  were  administered  during 
this  training  program  to  the  supervisors  or  the  subordi- 
nates, as  appropriate,  each  attempting  to  measure  some 
portion  of  the  training  effectiveness  criteria  (learning, 
behavior,  reaction  and  results)  discussed  in  Chapter  Two. 
Since  the  main  objective  of  the  training  program  was  to 
change  supervisors'  behavior  to  be  more  effective  in  dealing 
with  problem-solving  situations,  the  measures  of  the  subor- 
dinates* perceptions  of  supervisors'  behavior  in  using 
problem-solving  skills  is  of  primary  interest.   The  measure- 
ment was  done  with  the  Subordinate  Organization  Survey  (SUBQ) 
Part  III.   To  simplify  the  analysis,  this  data  was  subjected 
to  factor  analysis  and  two  factors  were  identified.   One  of 
the  problems  with  aggregating  data  in  this  manner  is  the 
inability  to  diagnose  specific  strengths  or  weaknesses  of 
the  training  program.   Data  aggregation  is  more  useful, 
however,  to  explain  why  the  overall  results  have  occurred. 
The  primary  purpose  of  this  thesis  is  to  determine  the 
overall  effectiveness  of  the  training  program,  so  using  the 
aggregated  data  appears  to  be  appropriate.   The  factors 
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identified  do  seem  to  make  sense  and  to  be  combining  vari- 
ables measuring  similar  properties.   The  factor  analysis  was 
based  on  data  from  the  first  administration  for  the  late- 
treatment  group,  and  the  same  factors  were  used  for  all 
administrations  for  each  group.   The  other  data  sets  were 
used  to  assess  the  criteria  of  learning,  reaction  and 
results  in  order  to  explain  the  behavior  ratings.   Part  II 
of  the  Subordinate  Organization  Survey  and  Supervisory 
Organization  Survey  measure  some  of  the  results  criteria, 
such  as  organizational  climate,  satisfaction  and  commitment. 
The  variables  associated  with  these  items  were  subject  to 
factor  analysis,  with  the  result  that  one  factor  for  each 
category  was  found  to  be  appropriate.   The  disadvantage  of 
aggregating  the  data,  as  noted  earlier,  is  the  inability  to 
pinpoint  a  specific  weakness  for  diagnostic  purposes.   The 
Multiple-Choice  Questionnaire  (MCQ)  measured  supervisors' 
knowledge  of  the  problem-solving  process  and  was  scored  on  a 
right/wrong  basis  for  each  question.   This  researcher 
completed  the  questionnaire  after  reading  the  descriptive 
material  for  the  training  program,  including  the  trainer's 
guide,  and  selected  all  the  answers  subsequently  identified 
as  correct  by  the  company  which  developed  the  training 
package,  providing  a  measure  of  face  validity  for  the  ques- 
tionnaire.  By  measuring  the  supervisors'  learning  (change 
in  knowledge)  of  the  problem-solving  process  after  training, 
one  source  of  behavior  differences  can  be  analyzed.   The 
Supervisory  Evaluation  of  Training  Questionnaire  (SETQ) 

60 


provides  a  measure  of  supervisor  reaction  to  the  training  as 
well  as  a  measure  of  intrinsic  motivation  and  extrinsic 
support.   Since  this  questionnaire  was  given  only  once 
(immediately  after  training)  for  each  group,  the  only 
comparisons  possible  are  between  the  early  treatment  group 
at  administration  two  and  the  late  treatment  group  at  admin- 
istration three.   These  comparisons  could  be  affected  by  the 
fact  that  the  late  treatment  group  completed  the  survey  one 
month  later  than  the  early  treatment  group. 

C .   SAMPLE 

The  data  comparisons  are  based  on  relatively  small 
sample  sizes,  which  affect  the  generalizability  of  the 
results  to  the  population  of  all  Coast  Guard  supervisors. 
In  addition,  the  results  may  be  contaminated  due  to  the  fact 
that  subordinates  usually  rated  more  than  one  supervisor 
and  that  each  supervisor  was  usually  rated  by  more  than 
one  subordinate.   This  could,  however,  serve  to  increase 
the  reliability  of  the  overall  ratings  because  of  the 
multiple  measurements  for  each  supervisor.   The  area  of 
greatest  concern  about  contamination  is  the  fact  that  some 
of  the  supervisors  who  received  the  training  also  completed 
surveys  as  subordinates.   This  could  tend  to  bias  the 
results,  although  the  direction  of  bias  is  not  predictable. 
The  supervisors  who  are  also  subordinates  and  were  exposed 
to  the  training  could  be  either  more  critical  after  training 
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or  more  perceptive  of  the  changes  in  their  supervisors' 
behavior.   The  validity  of  this  means  of  measuring  supervi- 
sors' behavior  is  somewhat  suspect.   It  is,  however,  the 
only  measure  of  behavior  available  in  this  analysis. 

D.   REGRESSION  PROCEDURE 

The  regression  analysis  described  in  Chapter  Three, 
Table  IX,  indicates  a  linear  significant  relationship 
(p  >  .0060)  between  administration  one  and  administration 
two  for  the  late  treatment  group  with  respect  to  all  sub- 
hypotheses  of  interest  except  sub-hypothesis  two  (subordi- 
nate perception  of  supervisors  "passing  the  buck"  with  regard 
to  problem  solving,  p  >  .1328)  and  sub-hypothesis  three 
(multiple-choice  questionnaire  score,  p  >  .8813).  For  these 
sub-hypotheses,  application  of  the  regression  procedure  would 
not  be  significantly  different  from  measuring  directly  the 
differences  in  the  actual  scores  between  early  and  late 
treatment  groups.   The  regression  procedure  used  assumes 
that  the  initial  means  and  standard  deviations  of  the  early 
and  late  treatment  groups  are  the  same.   If  this  is  not  the 
case,  results  would  be  erroneous.   A  comparison  of  the 
actual  score  means  for  each  sub-hypothesis  found  that  the 
means  and  standard  deviations  did  not  differ  significantly 
(at  p  >  .05).   Subordinate  satisfaction  and  supervisor 
commitment  showed  the  most  significant  differences  p  >  .134 
and  p  >  .100,  respectively)  between  the  means,  and 
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subordinate  satisfaction  the  most  significant  difference 
(p  >  .043)  between  the  standard  deviations.   This  will 
be  considered  in  the  discussion  of  the  results  of  the 
comparisons  of  subordinates1  satisfaction  and  of  supervi- 
sors' commitment  ratings. 

E.   RESULTS 

1 .   Behavior  Criteria:   Early  Treatment  Groups 

Hypothesis  A  examined  the  relationships  between  the 
early  and  late  treatment  groups  after  applying  the  regres- 
sion procedure  in  the  case  of  each  of  the  sub-hypotheses  of 
interest.   It  was  found  that  subordinate  perception  of 
supervisors'  behavior  was  not  significantly  different  after 
training  for  either  of  the  two  factors  examined-   The  most 
significant  factor,  "problem  solving  support"  (p  >  .110), 
showed  a  decrease  in  the  mean  score,  indicating  that  immedi- 
ately after  completion  of  the  training  subordinates  felt 
that  the  supervisors'  behavior  was  less  effectively  applied 
to  problem  solving  than  the  behavior  of  the  untrained  super- 
visors.  This  result  could  be  partially  due  to  the  subordi- 
nates having  higher  expectations  of  their  supervisors  after 
completing  the  4-week  training  package,  since  they  were 
aware  that  the  supervisors  were  being  trained  and  in  fact 
some  of  the  subordinates  were  also  considered  to  be  supervi- 
sors and  received  the  training.   The  training  could  have 
made  them  more  aware  of  the  problem  solving  process  and  of 
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any  differences  between  the  ideal  and  the  actual  behaviors. 
This  hypothesis  can  be  viewed  as  a  "negative  Hawthorne 
effect,''  affecting  the  external  validity  of  the  results, 
as  well  as  resulting  in  instrumental  decay  [Ref.  3]  (the 
instrument  no  longer  is  measuring  behavior  with  the  original 
criteria),  one  of  the  conditions  which  affects  internal 
validity.   Although  the  results  obtained  indicate  that  the 
training  had  no  significant  impact  on  subordinate 
perception  of  supervisors'  behavior,  there  are  enough  rival 
hypotheses  to  investigate  as  possible  explanations  of  these 
results  that  a  firm  conclusion  that  the  training  is  not 
effective  is  not  possible  without  further  study.   For 
example,  the  validity  of  using  the  Subordinate  Organization 
Survey  Questionnaire  instrument  as  the  measure  of  supervisor 
behavior  is  suspect  because  of  the  factors  mentioned  above. 
In  addition,  there  could  still  be  differences  in  long-term 
behavior  ratings,  which  were  examined  in  Hypotheses  C  and 
D.   In  testing  each  of  these  hypotheses,  however,  there  was 
no  significant  difference  in  supervisors'  behavior. 

Another  possible  explanation  is  that  the  impact  of 
training  differed  between  the  early  treatment  groups. 
Further  data  analysis  was  done  comparing  the  regression- 
adjusted  means  at  administration  two  for  groups  E3  and  E5 
(see  Figure  2.1)  that  showed  a  difference  for  the  second 
factor  ("passing  the  buck,"  p  >  0.010),  with  the  mean  for 
group  E3  decreasing  (as  desired  for  this  factor)  but 
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increasing  for  group  E5 .   There  was  no  difference  for  the 
first  factor.   A  t-test  comparing  the  means  of  the  actual 
ratings  for  group  E3  between  administration  one  and  adminis- 
tration two  showed  a  significant  decrease  (p  >  0.006)  for 
this  second  factor  (not  adjusted  using  regression  proce- 
dure).  Based  on  a  comparison  of  the  residuals  t-tests  and 
the  actual-ratings  t-tests  of  Hypothesis  A  (Tables  XI  and 
XII),  it  is  believed  that  this  strongly  significant  result 
would  remain  significant  after  the  regression-procedure 
adjustment.   There  is  no  significant  longitudinal  change  for 
group  E3  on  this  second  factor  for  the  last  two  administra- 
tions, indicating  that  the  training  may  have  a  lasting 
impact  on  this  factor  for  group  E3.   In  terms  of  behavior, 
this  result  indicates  that  the  training  was  effective  for 
one  group  on  one  factor,  but  overall  made  no  difference. 
This  information  is  useful  for  diagnostic  purposes,  but 
further  discussion  is  beyond  the  score  of  this  thesis. 

Another  possible  explanation  for  the  lack  of  training 
impact  on  the  early  treatment  group  compared  with  the 
late  treatment  group  at  administration  two  could  be  related 
to  demographic  differences.   Table  XVI  shows  the  mode  for 
each  of  the  categories  of  subordinate  demographic  data 
collected  on  the  Subordinate  Organization  Survey  Question- 
naire ( SUBQ ,  Part  I)  and  for  the  supervisors,  collected 
on  the  Supervisory  Organization  Survey  Questionnaire  ( SUPQ , 
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Part  I).   A  t-test  comparing  the  means  of  the  early  and  late 
treatment  groups  for  each  of  these  categories  showed  no 
significant  differences. 


TABLE  XVI 
Demographic  Data 


Mode    fc 
Subo  rdi 

r 

n  a  ~  e  s 

Mode 
Superv 

for 
isors 

"Ea~ 1 y " 
groups 

"La-e" 

Groups 

"Early" 
Groups 

"Late" 
Groups 

Age 

20-24 

20-24 

20-24 

20-24/ 
25-29* 

Sex    (percent    male) 

80. '4* 

77  .  5  ~n 

9  4  .  4  % 

100?! 

Years   in   the 
Coas-    Guard 

3 

2/4* 

5-7 

5-7 

Years   in 

Currant    issignmant 

<V2*    . 

<1/2* 

<1 

Years    worked    for 
Current    S  up  a  r  vi  s  o  r 

1-2 

1-2 

1-2 

1-2 

*  NOTE:   "x/x"  indicates  a  bi- modal  distribution 


2.   Behavior  Criteria:   Late  Treatment  Groups 

Hypothesis  B  examined  the  relationships  between  the 
early  and  late  treatment  groups'  actual  score  means  for  the 
sub-hypotheses  of  interest.   As  shown  in  Chapter  3,  Table 
XII,  subordinates'  perception  of  supervisors'  behavior  did 
not  change  significantly  after  training  for  either  of  the 
two  factors  examined.   This  result  indicates  that  supervi- 
sors' behavior  was  not  affected  by  the  training  program.   As 
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discussed  in  the  preceding  section,  however,  there  are  many 
rival  hypotheses  to  explain  why  training  did  not  appear  to 
have  an  impact  on  behavior.   These  include  rising  expecta- 
tions from  the  subordinates  and  their  changing  understanding 
of  what  is  the  ideal  standard  of  behavior  compared  with 
reality  ("instrumental  decay").   The  same  possibilities  for 
contamination  exist  for  these  late  treatment  groups  as  for 
the  early  treatment  groups  as  discussed  in  the  preceding 
section . 

The  study  of  the  longitudinal  effects  of  training  on 
supervisor  behavior  were  examined  in  Hypothesis  E,  with  no 
significant  difference  detected  for  the  combined  late  treat- 
ment groups.   Further  data  analysis  was  done  to  examine  the 
rival  hypothesis  of  differential  impact  of  training  on  the 
late  treatment  groups.   It  was  found  that  group  L6  showed  a 
significant  increase  (p  >  .055)  in  the  ratings  for  factor 
one,  "problem  solving  support."   No  significant  differences 
were  noted  for  group  L4  on  either  factor  or  for  L6  on  the 
second  factor.   No  significant  longitudinal  difference  was 
noted  for  group  L6  on  factor  one  between  administrations 
three  and  four,  indicating  a  possible  long  term  effect  for 
this  factor.   As  with  the  early  treatment  groups,  this 
result  indicates  that  the  training  was  effective  for  one 
group  on  one  factor,  but  overall  made  no  difference  on 
subordinate  perception  of  supervisors'  behavior.   Further 
study  to  determine  why  there  is  a  differential  effect  would 
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be  useful  for  diagnostic  purposes,  but  is  beyond  the  scope  of 
this  thesis. 

3 .   Learning  Criteria 

If  the  training  made  no  difference  on  supervisor 
behavior,  a  logical  first  step  toward  explaining  why  is  to 
examine  learning,  the  increase  in  knowledge  as  measured  by 
the  Multiple-Choice  Questionnaire.   Sub-hypothesis  H(A3) 
examined  the  difference  in  knowledge  after  training  for  the 
early  treatment  group  and  sub-hypothesis  H(B3)  examined  the 
differences  for  the  late  treatment  groups.   As  shown  in 
Chapter  3,  Table  X,  there  was  a  significant  increase  for  the 
early  treatment  group  (p  >  0.010).   For  the  late  treatment 
groups,  Table  XII  shows  an  increase  significant  at  only  the 
0.087  level.   The  mean  scores,  however,  appeared  to  be 
fairly  low.   The  mean  score  for  the  early  treatment  group 
was  only  59%  (9  of  15  correct)  and  for  the  late  treatment 
group  was  53%  (8  of  15  correct)  after  training.   Group  E3 
showed  a  significantly  higher  mean  score  (p  >  .100)  than 
group  E5  (67%  vs.  47%  correct)  after  training.   For  the  late 
treatment  groups,  C6  showed  a  significant  increase  in  knowl- 
edge (at  the  .029  level)  to  70%  correct,  while  L4  showed  no 
significant  increase  and  a  mean  score  of  37%  after  training. 
These  results  follow  the  results  in  the  previous  sections, 
indicating  that  the  training  was  effective  for  groups  E3  and 
L6 ,  but  overall  was  ineffective.   Although  when  this  number 
of  hypotheses  are  tested  some  are  bound  to  be  significant  by 
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chance,  it  is  felt  that  the  consistency  of  this  particular 
finding  (both  behavior  and  knowledge  were  found  to  be 
significantly  higher  for  groups  E3  and  L6 )  gives  it  more 
credibility  than  it  might  otherwise  merit  and  should  be 
considered  for  diagnostic  purposes. 
4 .   Results  Criteria 

Results  criteria  in  terms  of  subordinates'  and 
supervisors'  views  of  organizational  climate,  satisfaction 
and  commitment  to  the  Coast  Guard  were  measured  by  Part  II 
of  both  the  Subordinate  Organization  Survey  and  the 
Supervisory  Organization  Survey  questionnaires.   For  the 
early  treatment  groups,  sub-hypotheses  H(A4),  H(A5)  and 
H(A6)  examine  the  results  criteria  for  subordinates,  and 
sub-hypotheses  H(A7),  H(A8)  and  H(A9)  examine  these  criteria 
for  the  supervisors.   As  shown  in  Table  X,  there  is  no 
significant  change  for  the  supervisors  on  these  criteria, 
but  for  the  subordinates  there  is  a  significant  decrease 
immediately  after  training  for  all  three  categories. 
Hypotheses  C  and  D  examined  the  longitudinal  effects  for 
these  sub-hypotheses.   At  administration  three,  as  shown  in 
Table  XIII,  subordinate  commitment  shows  the  most  signifi- 
cant change  (p  >  .172),  moving  slightly  upward.   At  adminis- 
tration four,  as  shown  in  Table  XIV,  supervisor  commitment 
shows  the  most  significant  change  (p  >  .211),  also  moving 
slightly  upward.   In  summary,  for  the  early  treatment 
groups,  there  appears  to  be  no  change  for  the  supervisors 
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and  a  negative  change  for  the  subordinates  in  terms  of  the 
results  criteria. 

For  the  late  treatment  groups,  sub-hypotheses  H(B4), 
H(B5)  and  H(B6)  examine  the  results  criteria  for  subordi- 
nates and  H(B7),  H(B8)  and  H(B9)  examine  the  criteria  for 
the  supervisors.   As  shown  in  Table  XII,  there  is  no  signif- 
icant change  in  any  of  these  cases  immediately  following 
training.   Hypothesis  E  examines  the  longitudinal  effects 
for  these  sub-hypotheses.   As  shown  in  Table  XV,  subordinate 
commitment  shows  a  slight  increase  (p  >  .113)  for  adminis- 
tration four. 

These  results  indicate  a  difference  in  the  reception 
by  the  subordinates  between  the  early  and  late  treatment 
groups.   Perhaps  the  implementation  of  practice  of  the 
problem  solving  skills  was  handled  differently  between  the 
early  and  late  treatment  groups.   Further  study  of  this 
issue,  as  well  as  investigation  of  possible  differential 
effects  between  the  "early"  groups  and  between  the  "late" 
groups,  would  be  useful  for  diagnostic  purposes.   Within  the 
scope  of  this  research,  it  appears  that  training  has  not 
had  a  positive  impact  on  these  results  criteria,  and  for  the 
early  treatment  group,  the  impact  on  these  criteria  has  been 
negative . 

F.   CONCLUSIONS  AND  RECOMMENDATIONS 

The  overall  results  of  this  analysis  indicate  that  the 

training  package  was  not  effective  in  changing  the 
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supervisors'  behavior;  it  had  moderate  success  in  teaching 
a  knowledge  of  the  problem  solving  process;  it  had  a  negative 
impact  on  subordinate  perception  of  organizational  climate, 
satisfaction  and  commitment  to  the  Coast  Guard  for  the  early 
treatment  group  and  no  significant  impact  on  these  criteria 
for  the  late  treatment  group.   Figure  4.1  through  Figure 
4.9  provide  a  summary  of  the  results  of  the  study  of  the 
sub-hypotheses  considered  in  this  analysis.   A  "+"  or 
"-"  indicates  the  direction  of  change.   Without  further 
study  investigating  the  reasons  why  behavior  change  did  not 
occur  for  all  treatment  groups,  the  results  of  this  study 
suggest  that  the  U.S.  Coast  Guard  implementation  of  this 
training  package  should  not  proceed. 
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Figure  4.1   Problem  Solving  Support 
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Figure  4.2   Passing  the  Buck 
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Figure  4.3   Multiple-Choice  Questionnaire  Score 
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Figure  4.4   Subordinate  Perception  of  Organizational  Climate 
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Figure  4.5   Subordinate  Satisfaction 
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Figure  4.6   Subordinate  Commitment 
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Figure  4.7   Supervisor  Perception  of  Organizational  Climate 
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Figure  4.8   Supervisor  Satisfaction 


© 


(+,  p  >  .875)      (  +  ,  p  >  .211) 


HCC) 

K(A) 

(-,  .407) 


/--L    H(D)  ^ky 

©   © 


© 


<TVJ 


V  V  C-,  p  >  .792) 

H(B) 


(+,  p  >  .484) 

©      © 


Figure  4.9   Supervisor  Commitment 
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APPENDIX  A 
QUESTIONNAIRE  CODING 

A.   INTRODUCTION 

This  appendix  relates  the  four  survey  instruments  used 
to  study  the  effectiveness  of  the  "Problem  Solving  Skills 
for  Managers"  training  package  to  the  variable  names  and 
value  labels  assigned  to  the  SPSS  System  File  developed  to 
facilitate  the  analysis.   Four  separate  files  were 
established,  one  for  each  survey  instrument.   They  are: 
SUBQ  (Subordinate  Organization  Survey);  SUPQ  (Supervisory 
Organization  Survey);  MCQ  (Multiple  Choice  Questionnaire); 
and  SETQ  (Supervisory  Evaluation  of  Training  Questionnaire) 

The  questionnaires  were  administered  according  to  the 
following  schedule: 

Station  E300     Al     X     A2  A3     A4 

Station  E500     Al     X     A2  A3     A4 

Station  L400     Al  A2     X     A3     A4 

Station  L600     Al  A2     X     A3     A4 

Al  refers  to  the  first  administration,  A2  to  the  second 
administration  and  so  on.   SUBQ,  SUPQ,  and  MCQ  were  filled 
out  at  all  four  administrations.   SETQ  was  filled  out  only 
in  the  administration  immediately  following  treatment 
(designated  by  "X") . 
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B.   SUBORDINATE  ORGANIZATION  SURVEY 

This  questionnaire  was  given  to  subordinates  of  the 
supervisors  who  were  trained  or  scheduled  to  be  trained  as 
part  of  the  study  to  measure  how  supervisors  in  the  Coast 
Guard  work  with  their  subordinates.   The  first  five  ques- 
tions asked  for  some  biographical  data  of  the  survey 
respondents.   SUBQ106A  through  SUBQ108C  asked  for  the 
subordinates'  attitudes  or  opinions  about  what  it  is  like 
to  work  in  the  Coast  Guard.   The  remaining  questions  dealt 
specifically  with  how  the  subordinates'  supervisors  and 
others  work  with  them. 
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INTERACT  PERFORMANCE  SYSTEMS,  INC. 

SUBORDINATE  ORGANIZATION  SURVEY 

IMPORTANT  PLEASE  READ 

This  questionnaire  is  being  given  to  you  as  part  of  a  study  to  measure  how 
supervisors  in  the  Coast  Guard  work  with  their  subordinates.  There  are 
three  parts  to  this  questionnaire.  Part  I  asks  you  some  basic  questions 
about  yourself.  This  helps  us  make  sure  that  different  units  in  the  Coast 
Guard  are  included  in  a  fair  way.  Part  II  asks  for  your  attitudes  or 
opinions  about  what  it's  like  to  work  in  the  Coast  Guard.  Part  III  asks 
very  specific  questions  about  how  your  supervisor  and  others  work  with  you. 

All  of  your  answers  will  be  strictly  confidential.  Only  the  researchers  at 
Interact  Performance  Systems  will  have  access  to  your  questionnaire- 

This  questionnaire  will  be  repeated  in  a  few  months,  and  we  would  like  to 
learn  your  views  at  both  times.  In  order  to  follow  your  responses  over  the 
months  and  at  the  same  time. make  sure  you  remain  anonymous,  we  ask  that  you 
code  each  questionnaire  in  the  following  way. 

1.     Print  the  first   letter  of  your  Mother ' s 

first  name ■     > 


2.     Print  the  first   letter  of  your  Father ' s 
first  name 


3.     Print  the  two  numbers  which  represent  the 

day  of  the  month  of  your  birthday   .    .  i      r    ____  (17-20! 

Please  note  example: 

If  your  mother's  name  is  Mary  Smith ».    M 

If  your  father's  name  is  Robert  Smith  put  an  R 
in  the  space.     Please  do  not  put  a  B  even  if  his 
nickname  is  Bob -"-5. 

If  you  were  born  on  the  16th  of  the  month.    .    ».    1       6_ 

Or  if  you  were  born  on  the  5th  of  the  month.    .  »   0      5 

(Please  include  a  zero  in  the  first  space  if  you  were  born  before  the 
10th  of   the   month.) 

Name  of  your  current  supervisor: 

(21-24) 


Reprinted   With   Permission 
Co'pyrignt,    interact  Performance  Systems,    Inc.    1982 
All    Rights   Reserved 
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INSTRUCTIONS 


Most  questions  can  be  answered  by  choosing  one  of  the  answers  given.  If 
you  do  not  find  the  exact  answer  that  fits  your  case,  choose  the  one 
that   is  closest   to  it. 


2.     Answer  questions  by  circling  the  number  of  your  answer  choice,    as  shown 
in  this  example. 


Q:     To  what  extent  are  you  satisfied  with  the  _,^ 

car  you  drive?  12     3     4  (IT)  6     7 

(A  response  of  '5"  would  mean  that  you  are  satisfied  with  the 
car  you  drive  somewhere  between  "some  extent"  and  "great 
extent"   but   closer   to  "some   extent.") 


3.     Be  sure  each  answer  is  clearly   marked. 


PLEASE  ANSWER  EVERY  QUESTION 
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PART  I 


Page 


SU3Q101 


i.     Age' 

? 

a. 

b. 
c. 
d. 
e. 

under 
20  to 
25  to 
30  to 
35  to 

20 
24 
29 
34 
39 

SUBQ102 
2.     Sex 

? 

a. 

b.     1 

Female 
Male 

SUBQ103 
3.     Years  in 

the  Coast 

Guard? 

a. 

b. 
c. 
d. 
e. 

Less 

One 

Two 

Three 

Four 

than  1 

SUBQ104 
4.     Years  in 

current  assignment? 

a. 
b. 
c. 
d. 
e. 

Less 

One 

Two 

Three 

Four 

than  1 

SUBQ105 

f .  40  to  44 

g.  45  to  49 
h.  50  to  54 

i.  55  and  over 


(25) 


(26) 


f. 

5  to  7 

g- 

8  to  10 

h. 

11  to  15 

i. 

More  than  15 

(27) 


f.  5  to  7 

g.  8  to  10 
h.  11  to  15 

i.  More  than  15 


(28) 


5.  Time  spent  working  for  your  current  supervisor? 


a.  Less  than  3  months 

b.  3  to  6  months 

c.  7  to  11  months 

d.  1  to  2  years 
j.  3  to  4  years 


f. 
g- 
h. 

i. 


5  to  7  years 
8  to  10  years 
11  to  15  years 
More  than  15  years 


(29) 
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Page  4 


PART  II 


This  part  of   the  survey  contains  questions  about  what   it's   like  to  work  for 
the  Coast  Guard.     Once  again,    your  responses  will  be  confidential. 


To  what  extent: 

SUBQ1G6.      a-     Do  the  supervisors  and  those  senior  to  them 
at  this  unit  have  an  interest  in  the  well 
being  and  morale  of  the  people  who  work  here? 

SUBQ106b.     Do  the  supervisors  and  those  senior  to  them 
at  this  unit  try  to  improve  working 
conditions? 

SUBQ106c.  Do  your  supervisors  and  those  senior  to  them 
at  this  unit  schedule  the  work  that  needs  to 
be  done  with  the  subordinates  in  mind? 

SUBQ106d.     Do  you  feel  motivated  to  give  your  best 
effort   to  the  Coast  Guard? 

SUBQ106e-     Do  people  who  do  the  most  on  their  jobs  get 
rewarded  the  most? 

SUBQ106f.     Are  there  things  about  working  here  that 
encourage  you  to  work  hard? 

SUBQ106g.     Are  decisions  regarding  the  way  work  gets 
done  made  by  those  who  have  the  best 
information? 

SOBQ106h.     Is  information  in  this  unit     widely 

shared  so  that  those  who  make  decisions 
have  access  to  all  available  know-how? 

SUBQ106i.  Is  the  amount  of  information  you  get  about 
what  is  going  on  in  your  division  adequate 
for  you  to  do  a  better  job? 

SUBQ106j.     Do  you  get  the  information  you  need  about 

your  own  job  in  order  to  do  your  job  in  the 
best  way? 

SUBQ106k.  Is  your  supervisor  willing  to  listen  to  your 
ideas  and  suggestions? 

SUBQ1061.  Are  those  above  your  supervisor  open  to  your 
ideas  and  suggestions? 


12  3  4  5  6  7 


12  3  4  5  6  7 


12  3  4  5  6  7 


12  3  4  5  6  7 


1  2 


1  2 


4  5  6  7 


4  5  6  7 


12  3  4  5  6  7 


12  3  4  5  6  7 


12  3  4  5  6  7 


12  3  4 


6  7 


12  3  4  5  6  7 


12  3  4  5  6  7 


(30) 


(41) 
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SUBQ106  m*  Are  problems  discussed  in  a  professional  and 
helpful  manner? 

SUBQ106  Q*  D°  supervisors  and  those  senior  to  them  show 
concern  and  understanding  for  people  when 
talking  about  problems? 


12     3     4     5     6     7 


1     2     3    J     5     5     7 


(42) 


All  in  all,   how  satisfied  are  you  with: 

SUBQ1G  7.      a.     The  people  in  your  division? 

SUBQ10  7b.     With  people  in  the  Coast  Guard  who  are 
outside  your  division? 

SUBQ107c.     With  your  supervisor? 

SUBQ107d.     With  your  job? 

SUBQ107e.     With  your  pay? 

SUBQ107f.     With  the  way  problems  get  solved  in  your 
division? 


12  3  4  5  6  7 

12  3  4  5  6  7 

12  3  4  5  6  7 

12  3  4  5  6  7 

12  3  4  5  6  7 

12  3  4  5  6  7 


To  what  extent: 

SUBQ10  8.     a.     Would  you  consider  taking  a  job  similar  to 

the  one  you  now  have  (outside  the  Coast  Guard), 
in  the  same  city,   with  no  loss  of  benefits, 
and  with  a  10%  raise  in  pay? 

SUBQ108b.     Are  you  glad  you  chose  the  Coast  Guard  for 

a  career  over  the  other  career  opportunities 
you  might  have  had? 


12     3     4     5     6     7 


12     3     4     5     6     7 


SUBQ108c.     Are  you  committed  to  working  for  the  Coast  Guard 
as   long  as  your  personal  situation  (your 
health,   spouse's  or  family's  needs,   etc.) 
allows  you  to?  1 


2     3     4 


6     7 


(52) 
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PART   III 


The    last    section    focused   on   your  opinions  and   feelings.      This   section 
focuses  on  your  observations. 

The   following  questions  refer  to  how  your  supervisor  deals  with  problems  in 
your  division. 


To  what  extent:  o 

—  =  V 

a  o  l. 

SUBQ109*      a-     Does  vour  supervisor  keep  up-to-date  with 

theproblemsyouare   experiencing  on   the   job?        1      2     3     4   5  6  7  (53) 

SUBQ109b.     Does  your  supervisor  take  time  discussing 

your  point  of  view  on  your  work?  12     3     4     5     6     7 

SUBQ109c.  Does  your  supervisor  take  time  to  ask  you 
whether  there  are  ways  he  or  she  can  help 
make  your  job  easier?  12     3     4     5     6     7 

SUBQ109d.     Does  your  supervisor  come  to  your  work  area 
to  ask  you  whether  you  need  any  help  to  make 
your  job  easier?  12     3     4     5     6     7 

SUBQ109e.     Does  a  problem  have  to  get  out  of  hand  before 

your  supervisor  chooses  to  deal  with  it?  12     3     4     5     6     7 

SUBQ109f.     Does  your  supervisor  fail  to  deal  with 

problems  before  they  become  severe?  12     3     4     5     6     7 

SUBQ109g*     Does  your  supervisor  give  you  excuses  for  not 
solving  problems  that  show  you  he  or  she 
won't   "go  to  bat"  for  you?  12     3     4     5     6     7 

SUBQ109b.     Is  your  supervisor  unwilling  to  argue  or 

fight   for  you  to  solve  problems  you  bring  up?        12     3     4     5     6     7 

SUBQ109i.     Does  your  supervisor  refuse  to  take  on  the 
people  in  power  in  order  to  remove 
complaints  in  your  department?  12     3     4    5    6     7 

SUBQ109j.      is  your  supervisor  supportive  in  solving  work 

related  problems  you  want  help  with?  12     3     4    5    6    7 

SUBQ109k.     Does  your  supervisor  bring  resources  to  bear 

to  help  you  solve  problems  on  the  job?  1234567  (63) 
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SUBQ1091.     Does  your  supervisor  say  he  or  she  will  take 
action  on  a  problem  but  then  never  get  back 
to  you  to  solve  it? 

SUBQlOSb.     Does  your  supervisor  prccu.se  to  see  what  can 
be  done  about  a  problem  but  then  never   let 
you  know  what  he  or  she  did  to  solve  it? 

SUBQ109n.      Is  your  supervisor  quick  to  follow  through 

on  problems  you  bring  to  his  or  her  attention? 

SUBQ109o.     Does  your  supervisor  take  action  in  a  timely 
way  to  solve  complaints  you  bring  to  his  or 
her  attention? 

SUBQ10%).     Does  your  supervisor  get  on  your  case  too  much 
about   little  things  that  are  not  worth  the 

time  they'd  take  to  fix? 


1     2 


4     5     6     7 


12     3     4     5     6     7 


12     3     4 


(64) 


6     7 


10.   Talking  About  Problems  on  the  Job 


SUBQllQa.     When  your  supervisor  brings  up  a  problem, 
to  what  extent  is  he  or  she  clear  about 
exactly  what  is  bothering  him  or  her? 

SUBQllOb.     To  what  extent  is  your  supervisor  clear 
about  the  facts  of  problems? 

(That  is,    to  what  extent  does  he  or  she  use 
specific  statements  such  as,   "You  filed  the 
Jones  file  under  the  K's"   instead  of  vague 
statements  such  as,   'You  aren't  filing  these 
correctly.") 


12     3     4     5     6     7 
12     3     4     5     6     7 


11.   Talking  About  Problems 

SUBQllla«     T°  what  extent  does  your  supervisor  put  you 
down  when  describing  problems? 

SUBQlllb-     To  what  extent  does  your  supervisor  draw 
conclusions  about  you  as  a  person  when 
discussing  problems? 

(That  is,   to  what  extent  does  he  or  she  say 
things  about  you  like,   "You're   lazy,   you've 
got  a  bad  attitude,   you're  incompetent," 
instead  of  just  describing  what  is  wrong  with 
the  job?) 


12     3     4     5     6     7 


12     3     4     5     6     7 


(72) 
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12.  Listening  to  You 

When  you  talk  with  your  supervisor  about  work, 
to  what  extent  does  he  or  she: 
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SUBQ112a.     Listen  to  your  point  of  view  without 
interrupting  or  cutting  you  off? 

SU3Q112  b.     Demonstrate  by  restating  that  he  or  she 

fully  understands  the  point  you  are  trying 
to  make? 


12     3     4     5     6     7 


12     3     4     5     6     7 


(73) 


SUBQ112  c     Accurately  summarize  your  feelings  en  the 
matter? 


12     3     4     5     6     7 


SUBQ112  d.     Carefully  listen  without  arguing  or  becoming 
upset? 


12     3     4     5     6     7 


13.  a.  To  what  extent  does  your  supervisor  impose  a 
solution  to  a  problem  without  first  stopping 
to  figure  out  what  is  going  on? 


12     3     4     5     6     7 


SU3Q113  b.     To  what  extent  does  your  supervisor  "shoot 
from  the  hip"  when  solving  problems  instead 
of  stopping  to  learn  about  the  problem  first? 

SUBQ113  c.     To  what  extent  does  your  supervisor  blame  you 
for  problems  that  aren't  your  fault? 

SUBQ113  d.     When  discussing  a  problem  with  you,   to  what 
extent  does  your  supervisor  assume  you're 
the  cause  of  the  problem  when  you're  not? 


12     3     4     5     6     7 


12     3     4     5     6     7 


12     3     4     5     6     7 


(80) 


14.  Explaining  the  Reasons  Why  Something  Must  be  Done 
a  Certain  Way 


CARD  2 


SUBQllAa.     When  discussing  a  problem,   to  what  extent 
does  your  supervisor  clearly  explain  what 
would  go  wrong  with  the  job  if  the  problem 
weren't  corrected? 


12     3     4     5     6     7  (25) 


SUBQ114b.     To  what  extent  does  your  supervisor  explain 
how  correcting  a  problem  affects  the  job? 


12     3     4     5     6     7  (26) 
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15.   Answering  Questions  About  Why  Something  Must  be 
Done  a  Certain  Way 

SUBQ115a"     When  answering  questions  about  why  something 
must  be  done  a  certain  way,    to  what  extent 
does  your  supervisor  order  you  to  do  it  the 
way  he  or  she  wants? 

SUBQ115q.     when  answering  questions  about  why  something 
must  be  done  a  certain  way,    to  what  extent 
does  your  supervisor  threaten  you  with  what 
might  happen  if  you  don't  do  what  he  or  she 
wants? 


12     3     4     5     6     7 


12     3     4     5     6     7 


(27) 


SUBQ115 


When  answering  questions  about  why  something 
must  be  done  a  certain  way,   to  what  extent 
does  your  supervisor  use  his  or  her  "stripes' 
as  your  supervisor  to  get  you  to  do  what  he 
or  she  wants? 


12     3     4     5     6     7 


16.   Respecting  your  Ideas 

SUBQ116a.     To  what  extent  does  your  supervisor  treat  you 
in  a  way  that  shows  he  or  she  values  your 
experience  and  opinions  on  the  job? 

SUBQ116b.     To  what  extent  does  your  supervisor  show 

respect  for  your  ideas  and  abilities  on  the 
job? 


12     3     4     5     6     7 


12     3     4     5     6     7 


17.   To  what  extent: 


SUBQ117a.     Does  your  supervisor  try  to  find  ways  to 
make  the  job  easier  in  the  future? 

SUBQ117b.      Is  your  supervisor  concerned  about  making 
the  job  less  difficult  the  next  time  you 
have  to  do  it? 


12     3     4     5     6     7 


12     3     4     5     6     7 


(33) 
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18.   After  you  and  your  supervisor  have  discussed  a 
problem,   xo  what  extent: 

SUBQ113a.     Does  your  supervisor  leave  you  guessing  about 
what  should  happen  next? 


12     3     4     5     6     7 


(34) 


SU3Q1181 


SUBQ118' 


Is  it   left  unclear  as  to  who  will  do  what  to 
solve  the  problem? 

Can  you  be  sure  that  your  supervisor  will 
really  followup  to  see  that  the  problem  is 
solved? 


12     3     4     5     6     7 


12     3     4     5     6     7 


SUBQ118' 


Are  you  able  to  trust  that  your  supervisor 
will  do  what  the  two  of  you  have  agreed 
needs  to  be  done? 


12     3     4     5     6     7 


19.   Dealing  with  an  Upset  Subordinate 


SUBQ119 


a.  When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor  get 
angry  him  or  herself?' 


12     3     4     5     6     7 


SUBQ119b.     When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor 
get  into  an  argument? 


12     3     4     5     6     7 


SUBQ119c.  When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor  ask 
what  has  made  the  person  upset  or  angry? 

SUBQ119d.     When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor 
ask  the  person  what  is  bothering  him 
or  her? 


12     3     4     5     6     7 


12     3     4     5     6     7 


(41) 
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20.   Doing  Veil  en  the  Job  *  1  2 

SUBQ120&*     When  you  have  done  well  on  the  job,   to  what  o  §  2! 

extent     does  your  supervisor  simply  ignore 
what  you  have  done?  12     3     4     5     6     7  (42) 

SUBQ120D-     When  you  have  done  a  good  job,    to  what  extent 
does  your  supervisor  express  his  or  her 
appreciation  for  what  you  have  done?  12     3     4     5     6     7 


21.   To  what  extent: 

5UBQ121a.     Does  your  supervisor  act  in  ways   that  nuke 

it  hard  to  trust  him  or  her?  12     3     4     5     6     7 

SUBQ121b.     Does  your  supervisor  tell  you  whatever  he  or 
she  thinks  you  want   to  hear  in  order  to  get 
you  to  do  what     he  or  she  wants?  12     3     4     5     6     7  (45) 


C.   SUPERVISORY  ORGANIZATION  SURVEY 

This  questionnaire  was  given  to  supervisors  who  were 
trained  or  scheduled  to  be  trained  as  part  of  the  Problem 
Solving  Skills  for  Managers  Training  Program.   The  first 
five  questions  asked  for  some  biographical  data  of  the 
survey  respondents.   SUPQ106A  through  SUPQ108C  asked  for 
the  supervisors'  attitudes  or  opinions  about  what  it  is 
like  to  work  in  the  Coast  Guard  (i.e.  Organizational 
Climate,  Satisfaction  and  Commitment).   The  remaining 
questions  dealt  with  the  supervisors  knowledge  of  problem 
solving  and  their  perceptions  of  organizational  support. 
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USCG  (1-4) 

S    U    P  Q  (  6  -  S ) 

A    D    M  I    N  (10) 

UNIT  (12-15) 


INTERACT  PERFORMANCE  SYSTEMS,    INC. 
SUPERVISORY   ORGANIZATION  SURVEY 


IMPORTANT  PLEASE  READ 

This  questionnaire  is  being  given  to  you  as  part  of  a  study  to  measure  your 
opinions  and  observations  about  your  work.  All  your  answers  w i  1 1  be 
strictly  confidential.  Only  the  researchers  at  Interact  Performance  Systems 
will  have  access  to  your  questionnaire. 

This  questionnaire  will  be  repeated  in  a  few  months,  and  we  would  like  to 
learn  your  views  at  both  times.  In  order  to  do  this,  please  print  your  name 
in  the  space  below. 


Name: 


17-20) 


Once   again,  only   the   researchers  at   Interact  Performance  Systems    will    have 
access   to  your  survey. 


Reprinted   With   Permission 
Copyright,  Interact  Performance  Systems,   Inc.,  1982 
All    Rights   Reserved 
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INSTRUCTIONS 


1.  Most  questions  can  be  answered  by  choosing  one  of  the  answers  given.  If 
you  do  not  find  the  exact  answer  that  fits  your  case,  choose  the  one 
that   is  closest  to   it. 


2.     Answer  questions  by  circling  the  number  of  your  answer  choice,    as  shown 
in  this   example. 


Q:     To  what  extent  are  you  satisfied  with  the  ^^ 

car  you  drive?  12     3     4  (T)  6     7 

(A  response  of  "5"  would  mean  that  you  are  satisfied  with  the 
car  you  drive  somewhere  between  "some  extent"  and  "great 
extent"   but   closer   to   "some   extent.") 


3.      Be  sure  each  answer  is  clearlv  marked. 


PLEASE  ANSWER  EVERY  QUESTION 
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S'JPQIOl 
1 .     Age? 

a. 
b. 


d. 
e. 


under  20 
20  to  24 
25  to  29 
30  to  34 
35  to  39 


(25) 


f.  40  to  44 

g.  45  to  49 
h.  50  to  54 

i.  55  and  over 


SUPQ102 
T.     Sex? 


(26) 


Female 
Male 


SUPQ103 

3.  Years  in  the  Coast  Guard 


(27) 


a.  Less  than  1 

b.  One 

c.  Two 

d.  Three 

e.  Four 


f .  5  to  7 

g.  8  to  10 
h.  11  to  15 

i.  More  than  15 


SUPQIO^ 

4.     Years  in  current  assignment? 


(28) 


a.  Less  than  1 

b.  One 

c.  Two 

d.  Three 

e.  Four 


f. 

5  to  7 

g- 

8  to  10 

h. 

11  to  15 

i. 

More  than  15 

SUPQ1Q5 

5.  Time  spent  working  for  your  current  supervisor? 


a.  Less  than  3  months 

b.  3  to  6  months 
c  7  to  11  months 

d.  1  to  2  years 

e.  3  to  4  years 


(29) 


f.  5  to  7  years 

g.  8  to  10  years 
h.  11  to  15  years 

i.  More  than  15  years 
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PART   II 

This  part   of   the   survey   contains  questions  about   what   it's    like  to  work  for 
the  Coast  Guard.     Once   again,    your   responses  Till   be  confidential. 


To  what  extent:  ro  *  i 

T3  w 

SUPQ10  6.      a.      Do  the  supervisors  and  those  senior  to  them  S  §  £ 

at  this  unit  have  an  interest  in  the  well 
being  and  morale  of  the  people  who  work  here?  1     2     3     4     5     6     7  (30) 

SUPQ106p.     Do  the  supervisors  and  those  senior   to  them 

at  this  unit  try  to  improve  working  conditions?     12     3     4     5     6     7 

SUPQ106C.     Do  the  supervisors  and  those  senior  to  them  at 
this  unit  scbedule  the  work  that  needs  to  be 
done  with  the  subordinates  in  mind?  12     3     4     5     6     7 

SUPQ106d.     Do  you  feel  motivated  to  give  your  best 

efforts  to  the  Coast  Guard?  12     3     4     5     6     7 

SUPQ106e.     Do  people  who  do  the  most  on  their  jobs  get 

rewarded  the  most?  12     3     4     5     6     7 

SUPQ106f.     Are  there  things  about  working  here  that 

encourage  you  to  work  hard?  12     3     4     5     6     7 

SUPQ106g.     Are  decisions  regarding  the  way  work  gets 
done  made  by  those  who  have  the  best 
information?  12     3     4     5     6     7 

SUPQ106h.      Is  information  in  this  unit  widely 

shared  so  that  those  who  make  decisions 

have  access  to  all  available  know-how?  12     3     4     5     6     7 

SUPQ106i.  Is  the  amount  of  information  you  get  about 
what  is  going  on  in  your  division  adequate 
for  you  to  do  a  better  job?  12     3     4     5     6     7 

SUPQIObj.     Do  you  get  the  information  you  need  about 
your  own  job  in  order  to  do  your  job  in 
the  best  way?  12     3     4     5     6     7 

SUPQ10&.      Is  your  supervisor  willing  to  listen  to  your 

ideas  and  suggestions?  12     3     4     5     6     7 

SUPQ1061.     Are  those  above  your  supervisor  open  to  your 

ideas  and  suggestions?  12    3    4    5    6    7  (41) 
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SUPQ106  m.  Are  problems  discussed  in  a  professional  and 

helpful  manner?  1234567  (42) 

SUPQ106  n.      Do  your  supervisors  and  those  senior   to  them 
show  concern  and  understanding  for  people 
when  talking  about  problems?  12     3     4     5     6     7 


All   in  all,   how  satisfied  are  you  with:  £  ■;  £  S 

SUPQ107-      a-      The  people  in  your  division?  12  3  4  5  6  7 

SUPQ107  b.     With  people  in  the  Coast  Guard  who  are  out- 
side your  division?  12  3  4  5  6  7 

SUPQ107  c.     With  your  supervisor?  12  3  4  5  6  7 

SUPQ107d.     With  your  job?           '  12  3  4  5  6  7 

SUPQ107e.     With  your  pay?  12  3  4  5  6  7 

SUPQ107  f .     With  the  way  problems  get  solved  in  your 

division?  12  3  4  5  6  7 


To  what  extent: 

SUPQ108.     a.     Would  you  consider  taking  a  job  similar  to 

the  one  you  now  have  (outside  the  Coast  Guard), 

in  the  same  city,  with  no  loss  of  benefits, 

and  with  a  10%  raise  in  pay?  12     3     4     5     6     7 

SUPQ108b.     Are  you  glad  you  chose  the  Coast  Guard  for 

a  career  over  the  other  carreer  opportunities 

you  might  have  had?  12     3     4     5     6     7 

SUPQ108c.     Are  you  committed  to  working  for  the  Coast 
Guard  as   long  as  your  personal  situation 
(your  health,    spouse's  or  family's  needs, 
etc.)  allows  you  to?  12     3     4     5     6    7  (52) 
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This  part  of  the  survey  contains  questions  about  different  approaches  you 
might  use  to  solve  problems  on  the  job.  Different  training  programs 
recommend  different  approaches  to  solving  problems,  but  we  are  inxerested  in 
your  opinion  as  to  which  approaches  you  find  useful  in  the  Coast  Guard. 


1.     When  beginning  a  problem  solving  discussion  with 
a  subordinate,   to  what  extent  do  you  feel  it  is 
useful   to: 

SUPQ109a.     Begin  the  discussion  by  noting  what  the  sub- 
ordinate is  doing  well  before  bringing  up 
the   problem? 

SUPQ109b.     Begin  by  discussing  the  facts  and  details  of 
the  problem  so  that  you  won't  get  into  an 
argument  about  what  happened? 

SUPQ109C  Begin  the  discussion  by  asking  what  is  going 
on  so  that  the  subordinate  will  feel  free  to 
discuss  his  or  her  concerns? 


3     4     5     6     7 


12     3     4     5     6     7 


2     3     4     5     6     7 


(53) 


To  help  a  subordinate  overcome  a  problem  that  is 
preventing  him  or  her  from  doing  his  or  her  job, 
to  what  extent  do  you  feel  it  is  useful  to  start 
by: 


SUPQ11P" 

SUPQllOa. 
SUPQ11CP- 


Finding  someone  with  more  experience  or  know- 
ledge than  the  subordinate  to  help  him  or  her 
with  the  job? 

Asking  the  subordinate  what  he  or  she  thinks 
is  the  best  way  to  solve  the  problem? 

Using  your  own  skill  to  decide  what  needs  to 
be  done  and  have  the  subordinate  do  it? 


12     3     4     5     6     7 


12     3     4     5     6     7 


12     3     4     5     6     7 


(58) 
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3.     When  subordinates  complain  about  doiru:  a  job  —  =  £ 

that   is  hard   but   necessay   to  do,    to  what  ex-  «  £ 

tent  do  you  feel   it  is  important  to:  ™  « 

SUPQllla.     Maintain  control  by  focusing  on  the  specific  ° 

disciplinary  actions  you  could  take?  12     3     4     5     6     7  (59) 

cHpoTii  b.     Remind   them  they  work  under  you  and  that  it's 

your  job  to  make  the  decisions?  12     3     4     5     6     7 

SUPQ111  c.     Stay  on  top  of  the  situation  by  telling 

them  that  they  must  do  the  job  the  way  you 

tell  them  to?  12     3     4     5     6     7 

SUPQ111  d.     Let  them  know  you  will  help  them  later  if 

they  help  you  now?  12     3     4     5     6     7 

SUPQ111  e.     Promise  them  some  sort  of  reward  for  putting 

out  the  extra  effort?  12     3     4     5     6     7 

SUPQ111  f.     Remind  them  of  what  could  happen   to  the  job 

if  they  do  not  put  out  the  extra  effort?  12     3     4     5     6     7 


4.     When  one  of  your  subordinates  gets  upset  or 
angry,    to  what  extent  do  you  feel   it  is  useful 
to: 

SUPQ112a-  Inform  the  subordinate  of  the  disciplinary 
actions  you  will  take  if  he  or  she  doesn't 
control  his  or  her  temper?  12     3     4     5     6     7 

SUPQ112b.     Ask  the  subordinate  to  cool  off  before 

discussing  the  matter  with  you?  12     3     4     5     6     7 

SUPQ112  c.     Ask  the  subordinate  to  go  for  a  walk,    get  a 
drink,   or  take  a  break  so  that  he  or  she 
will   be   less  emotional  when  you  discuss  the 
problem?  12     3     4     5     6     7 

SUPQ112d.     Avoid  getting  into  the  subordinate's  emotions 

by  focusing  on  the  job?  12     3     4     5     6     7 

SUPQ112e*     Ask  f°r  details  about  what  is  making  the 

subordinate  upset?  12     3     4     5     6     7 

SUPQ112  f>  Tell  the  subordinate  you  have  felt  the  same 
way  before  and  that  you  sympathize  with  his 
or  her  anger?  12    3    4    5    6    7  (70) 
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5.  When  you  have  to  deal  with  a  tough  problaii  or  a 

touchy  situation  with  one  of  your  subordinates,      %  « 

to  what  extent  do  you:  ~  2 

Z  I/O  'J 

SUPQ113a.      Feel   stress  or  tension?  12     3     4     5     6     7  (71) 

SUPQ113b.     Feel  confident  and  sure?  12     3     4     5     6     7 

SUPQ113c.     Feel  annoyed  or  irritated?  12     3     4     5     6     7 

6.  To  what  extent  do  your  subordinates: 

SUPQ114a.     Create  problems  you  have  to  solve?  12     3     4     5     6     7 

SUPQ114b.     Need  to  be  watched  if  they  are  to  put  out 

their  best  effort?  12     3     4     5     6     7 

SUPQ114C-     Need  to  be  told  what   to  do  next  en  the  job?  12     3     4     5     6     7 

SUPQ114CU     Lack  the  ability  or  experience  to  do  their 

•  jobs  without  your  guidance?  12     3     4     5     6     7 

SUPQ114e-     Try  to  a-PPe3-1"  "innocent"  instead  of  taking 

responsibility   for  problems  they  have  caused?         12     3     4     5     6     7 

SUPQ114^"     Give  questionable  or  unlikely  excuses  to 
avoid  blame? 


12     3     4     5     6     7 

12     3     4     5     6     7 

(80) 
1  CARD  2| 

SUPQ114S-     Try  to  undermine  your  respect  and  authority? 

SUPQ114n.     Act  in  ways  that  question  your   leadership?  12     3     4     5     6     7  (25) 

SUPQ114i.     Take  offense  at  little  things  that  shouldn't 

matter?  12     3     4     5     6     7 

SUPQ114J*     Get  angry  or  defensive  without   good   reason?  12     3     4     5     6     7 

SUP0114^'     ^et   frustrated  too  easily  when  a  difficult 

job  must  be  done?  12     3     4     5     6     7 

SUPQ114]..     Try  to  take  advantage  of  you  if  you  try  to 

be  their  friend?  12     3     4     5     6     7  (29) 
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7.     To  what  extent:  ~  * 

*j  E  a* 

SUPOH?"      Is  Just  doing  a  good  J°b  important   to  your  z  ^  ° 

su'oordinate?  12     3     4     5     6     7  (30) 

5UPQH5t>-     Do  your  subordinates  take  an  interest  in 

doing  their  best  on  the  job?  1234567      (17) 


8.     To  what  extent  do  you: 

SUPQ116  a.     Set  aside  extra  time  each  day  to  ask  sub- 
ordinates about  problems  in  their  work  areas?         12     3     4     5     6     7 

SUPQ116  b.     Sit  down  and  plan  how  you  will  solve  a  prob- 
lem with  a  subordinate  before  going  out  and 
solving  it?  12     3     4     5     6     7 

SUPQ116  c.     Rehearse  in  your  mind  what  you  will  say  to  a 
subordinate  before  starting  a  problem-solving 
discussion?  12     3     4     5     6     7 

SUPQ116  d.  Pause  to  list  in  your  head  what  the  results 
of  a  problem  might  be  before  discussing  the 
problem  with  a  subordinate?  12     3     4     5     6     7 

SUPQ116  e.     Stop  to  think  of  all  the  reasons  a  job  needs 
to  be  done  a  certain  way  before  discussing 
the  job  with  a  subordinate?  12     3     4     5     6     7  (36) 
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9.     To  what  extent  do  other  supervisors  you  work 
with: 


SUPQil73--     Discuss  problems  with  you  before  the  problem  °  " 

gets  out  of  hand0  12     3     4     5     6     7  (37) 

SUPQ117D-     Ask  for  your  point  of  view  as  to  what  is 

causing  a  problem?  12     3     4     5     6     7 

SUPQ117C*     w°rk  with  you  instead  of  blaming  you  when 

problems  come  up.  12     3     4     5     6     7 

SUPQ117^'     Discuss  problems  without  becoming  upset  or 

raising  their  voices?  12     3     4     5     6     7 

SUPQ117e.     Show  respect  for  your  experience  and 

expertise?  12     3     4     5     6     7 

SUPQ117f.     Follow  through  on  their  commitments  to  you?  12     3     4     5     6     7 

SUPQ117g.      "Go  to  bat"  for  you  by  taking  on  others 

when  it  is  required?  12     3     4     5     6     7 

SUPQ117h.     Take  action  on  problems  that  you  bring  to 

their  attention?  12     3     4     5     6     7 


10.   To  what  extent  does  your  supervisor: 

SUPQ11&"     Discuss  problems  with  you  before  the  problem 

gets  out  of  hand?  12     3     4     5     6     7 

SUPQ1183-     Ask  for  your  point  of  view  as  to  what  is 

causing  a  problem?  12     3     4     5     6     7 

SUPQllSfc-     Work  with  you  instead  of  blaming  you  when 

problems  come  up?  1234567 

SUPQ1183-     Discuss  problems  without  becoming  upset  or 

raising  their  voices?  12     3     4     5     6     7 

SUPQll^-     Show  respect  for  your  experience  and 

expertise?  12     3     4     5     6     7 

SUPQllS^*      Follow  through  on  their  commitments  to  you?  12     3     4     5     6     7 

SUPQlljg'      "Go  to  bat"  for  you  by  taking  on  the  others 

when  it  is  required?  12     3     4     5     6     7 

SUPQII81.     Take  action  on  problems  that  you  bring  to 

their  attention?  12     3     4     5     6     7  (52) 
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D.   MULTIPLE  CHOICE  QUESTIONNAIRE 

This  questionnaire  was  given  to  supervisors  who  were 
trained  or  scheduled  to  be  trained  as  part  of  the  Problem 
Solving  Skills  for  Managers  Training  Program.  MCQ101 
through  MCQ115  measured  the  supervisors'  knowledge  about 
problem  solving.  The  remaining  questions  dealt  with  the 
supervisors'  recognition  of  opportunities  to  use  problem 
solving  skills. 
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M   C    Q       <2-~ 

A    D   M    I    N (9) 

UNIT "(11-14; 


INTERACT  PERFORMANCE  SYSTEMS 
MULTIPLE  CHOICE  QUESTIONNAIRE 


Name: 


(16-20; 


The  following  questions  provide  situations  you  might  face 
at  work,  and  give  five  different  ways  you  might  respond  to 
them.  Pick  the  one  best  response  by  circling  the  number 
in  front  of   it. 


MCQ101 

A.  You  notice  a  person  who  has  been  working  for  you  only  a  short  period  of 
time  using  the  wrong  form  for  an  important  report  You  approach  him  or 
her  and  state: 

1.  "Do  you   need  any  help  on   this?" 

2.  'You're  using   the  wrong   form   for  this   report.      Is   there  anything  we 
can  do  to  avoid  this  happening  in  the  future?" 

3.  "I   notice  you   are  using   the  CG   3312A   form  and  this  report  calls   for 
theCG  3307  form." 

4.  "When    you   use    the    CG    3312A    form    we    don't    get    the    information 
required  by   by   District." 

5.  "Is  there  anything  I  can  do  to  help  you  learn  which  forms  to  use  for 
the  different  reports  you  prepare?" 

MCQ102 

B.  In  talking  with  a  subordinate,  you  become  aware  of  a  rather  complicated 
problem.  You  have  a  fairly  good  idea  why  the  problem  exists,  but  are 
not  totally  certain. 


'You  9eem  to  be  having  a  problem  with 


Is  it  because  of   .    .    .?" 
.    What    do   you 


"Here   is   what   I"  think    is   causing   the   problem 
think?" 


'Thanks   for  pointing  the  problem  out       I'll  check  into  it  and  get 
back  with  you  later  this  afternoon." 

'Thanks  for  pointing  the  problem  out.     Do  you  want  me  to  get  you 
some  help  to  solve  it?" 


5.      "What  do  you  think  might  be  causing  this  problem?" 


Reprinted  With   Permission 
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(25) 


(26) 
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mi&3 


e-of  your  subordinates   finishes  a  complicated   inspection  ahead  of 
schedule  making  it  possible   for  you  to  get  under  way  ahead  of  time. 

You  approach  the  subordinate  and  state: 

1.  "Finishing   that    inspection  ahead  of  schedule   really   helped   out. 
What  can  I  do  to  help  you  beat  schedules  in  the  future?" 

2.  "Finishing  that   inspection  this  morning  made  it  so  I  could  get  under 
way  ahead  of  time.     Thanks." 

3.  "I    really    appreciate    your    finishing    that    inspection    ahead    of 
schedule   this   morning.      Thanks."  (27) 

4.  "Because  of  your  good  attitude,    we  were  able  to  get  under  way  ahead 
of  schedule.     That  was  really  important  to  the  crew.     Thanks." 

5.  'You're  a  real   dependable   person.      Being  able   to  depend  on  you  takes 
alot  of  pressure  off  me.     Keep  it  up." 


MC0104 


You  observe  a  subordinate  using  a  shortcut  to  complete  an  important 
electrical  test.  After  you  explain  that  failure  to  follow  the  test 
procedures  could  produce  inaccurate  results,   the  employee  says: 

'This  shortcut  won't  make  the  test  all   that  inaccurate, 
and  besides,  we've  got  such  a  backlog  of  these  tests. 
This  shortcut  really  helps  me  out." 

Knowing  that  the  regular  procedures  are,  in  fact,  appropriate  and  that 
you  have  to  motivate  the  person  to  use  them  —  you  respond: 

1.  'You  seem  upset,    is   it   because  you  feel   the  tests  take  too  much 
time?" 

2.  "Maybe  these  procedures  are  a  bit  too  rigid.      I'll  check  into  it  and 
let  you  know." 

3.  "If  the  tests  are  any   less  accurate  it  could  damage  the  equipment."  (28) 

4.  "Is    there    anything    I    can    do    to    help    you    follow    the    correct 
procedures?" 

5.  "I  know  the  procedures  seem  picky,  but  I'd  really  appreciate  it  if 
you  would  follow  them  exactly." 
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MCQ105        __  ^se  3 

E.  You  observe  that  the  lookout  on  watch  is  absent-mindedly  staring  at  the 
deck  rather  than  alertly  scanning  the  horizon.  After  explaining  that 
the  way  he  or  she  is  looking  for  ships  is  not  active  or  alert  enough, 
the   lookout  says: 

'Trying  to  keep  a  lookout  here  is  just  busy  work.  There 
are  hardly  ever  any  ships  out  here.  Besides,  the  radar 
will  show  what's  out  there  anyway." 

Knowing  that  keeping  an  active  watch  is  important,    you  respond: 

1.  "I    appreciate    that    it's    tough,      but    it's    your    job    and    I    have 
confidence  you  can  do  it." 

2.  "I  can  see  yore  really  bored.      Is  there  anything  I  can  do  to  help 
you  stay  alert? 

3.  "I   understand  your  concern,    but   trust   me,    keeping  an  alert  watch  is 
critical."  (29) 

4.  "I   know  what  you  mean.      Maybe  we  can  manage  with  just   the   radar  for 
a  while." 

5.  "If   you  don't  keep  an  alert  watch  we  could  miss  craft  that  radar 
doesn't  pick  up." 


MCQ1Q6 

F.  A  subordinate  has  just  come  to  you  with  a  work-related  problem.  The 
subordinate  is  VERY  ANGRY  about  the  equipment  he  or  she  has  to  work  with 
and  states: 

"This  #*%!   equipment   is  driving  me  nuts! 
It's  way  too  slow!" 

You  respond 

1.  "What  seems  to  be  the  exact  problem?" 

2.  "What's  making  you  mad  is  that  the  equipment  is  slowing  you  down?" 

3.  "Could  you  help  me  understand  how  this  could  affect  our  schedule?"  (30) 

4.  "Is  there  anything  I  can  do  to  help  you  solve  the  problem?" 

5.  "Do  you   think   we   can  gather  information   in  order  to   figure  out  why 
it  is  slowing  so  much?" 
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MC0107 

G.     You    notice    an    experienced    subordinate    involved    in    an    unsafe    work 
practice.      You  approach  him  or  her  and  state: 

1.  'This  is  the  third  time  this  week  I've  noticed  you  standing  inside 
the  recommended  safe  distance  of  this  equipment." 

2.  'You  shouldn't   be  doing  that.     You  could  get  hurt." 

3.  "If  that  machine  acts  up  it  could  break  your  wrist."  (31) 

4.  "I'd  really  hate  to  see  you  get  hurt.     Try  to  be  safer  fran  now  on." 

5.  'You're  working  in  an  unsafe  manner       Is  there  anything  we  can  do  so 
it  won't  happen  in  the  future?" 


MCQ1Q8 

H.     You've   just   spoken   to  a  subordinate   about   using   an   incorrect   procedure. 
The  suborinate  becomes  furious  and  states: 

"I'm  not  the  only  one  who  does  the  job  this  way! 
Why  pick  on  me?" 

You  respond: 

1.  "Is    there    a   way    I    can    help    you    so    you   won't   have   to   use   this 
incorrect  procedure  in  the  future? 

2.  "Using    this    procedure    could    result    in    a    loss    of    water    tight 
integrity." 

3.  "I  know  other  people  do  the  job  this  way  too,   but  right  now  we're 
talking  about  you."  (32) 

4.  'You  seem  upset.     Do  you  think  I'm  picking  on  you?" 

5.  "I   can   see  you're  pretty   upset   about   this.      Why   don't   you   take  a 
break  for  a  few  minutes  and  then  we  can  talk  about  it." 
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I.  One  of  the  best  subordinates  in  your  engineering  department  has  been 
working  for  several  hours  on  a  very  complicated  part  in  the  air 
conditioning  system  and  has  made  little  headway.  You  approach  the 
subordinate  and  he  or  she  says: 

"Let's  see  if  I  can  explain  what's  going  on  here.  The 
inner-flange  on  this  part  needs  to  be  rounded  to  within 
one  one-thousandth  in  order  to  set  the  bearing  and  seal 
combination.  I've  got  part  of  it  ground  out,  but  the 
ledge  where  the  seal  goes  isn't  right  and  I  need  to  figure 
out  a  way  to  make  a  diagonal  cut  so  that  I  can  get  it  to 
tolerance. " 

You  respond: 

1.  "Sounds  to  me  like  you've  got  a  good  start  at  solving  the  problem. 
If  you  keep  at  it,  I  have  confidence  that  you'll  be  able  to  solve 
it." 

2.  "I'll  get  another  engineer  to  help  you.  Meanwhile,  you  keep  working 
at  it  so  that  we  can  complete  this  repair  on  schedule  and  meet  our 
commitment  by  five  tonight." 

3.  "This  problem  sounds  pretty  complicated,  what  do  you  think  is 
causing  it?"    .  (33) 

4.  "It  sounds  to  me  like  you  could  use  some  help  from  the  company  that 
designed  this." 

5.  "Let's  see  if  I  understand.  You've  got  part  of  the  job  done,  but 
you  are  being  slowed  down  because  of  troubles  in  grinding  out  the 
ledge." 


Answer   the    following   questions   by   circling   the  number   in    front  of 
the  response  that  you  think  best  deals  with  the  situation. 


MCQ110 

J.      In  observing  a  problem  with  a  subordinate,    it  is  best  to  first: 

1.  Ask  the  subordinate  what  he  or  she  is  doing  and  why. 

2.  Ask  what  you  can  do  to  help. 

3.  Make  the  subordinate  feel  at  ease  by  first  striking  up  a  friendly 
conversation.  (34) 

4.  Describe  the  nature  of  the  problem  in  detail. 

5.  Explain  the  consequences  of  what  the  subordinate  is  doing. 
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K.      When  working  with  a  subordinate  in  order  to  find  out  why  a  particular 
problem  he  or  she  faces  exists,    it  is  best  to: 

1.  Bring  two  or  more  subordinates  together  to  involve  them  all  in 
participative  decision  making. 

2.  Outline  what  you  think  the  source  of  the  problem  is  and  ask  the 

subordinate  what  he  or  she  thinks- 

3.  Ask   the   subordinate   if   he   or  she   would   like  you  to  bring  in  an  (35) 
expert  to  help  solve  the  problem. 

4.  Ask  the  subordinate  what  he  or  she  thinks  the  source  of  the  problem 
is. 

5.  Ask  what  you  can  do  to  help. 

MCQ112 

L.  When  a  subordinate  questions  the  reason  why  something  has  to  be  done  a 
certain  way  (and  you  know  the  reason),  it  is  best  to: 

1.  Explain  the  impact  that  doing  it  the  required  way  has  on  the  way  the 
job  comes  out. 

2.  Express  your  appreciation  for  the  subordinates  concern,  but  maintain 
your  authority  by  assuring  him  or  her  that  those  who  designed  the 
method  knew  what  they  were  doing. 

3.  Work  with  the  subordinate  in  order  to  determine  what  can  be  done  in     (36) 
order  to  simplify  making  it  the  required  way. 

4.  Ask  the  subordinate  whether  you  can  help  him  or  her  do  the  job  in 
the  correct  way. 

5.  Express  your  appreciation  for  the  subordinate's  concern  and  tell  him 
or  her  that  you  will  check  into  the  matter  in  detail. 

MCQ113 

M.     When  a  subordinate  does  an  outstanding  job,    it  is  best  to  first: 

1.  Indicate  that  you  are  pleased  with  what  he  or  she  had  done  and  that 
you  hope  he  or  she  will  be  able  to  achieve  similar  results  in  the 
future. 

2.  Describe  in  detail  what  the  subordinate  did,  express  your 
appreciation  and  describe  what  happend  as  a  result  of  it. 

3.  Put  the  subordinate  at  ease  by  starting  with  some  friendly 
conversation.  (37) 

4.  Express  your  sincere  appreciation  for  what  the  subordinate  did,  and 
explain  what  happened  as  a  result. 

5.  Express  your  appreciation,  describing  what  happened  as  a  result,  and 
tell  them  you're  glad  they  have  such  a  good  attitude- 
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MCQ114 

N.      In  dealing  with  an  angry  subordinate,    it  is  best   to: 

1.  Go  right  to  problem-solving  in  order  to  avoid  having  the  subordinate 
get  more  and  more  angry. 

2.  Ask  the  subordinate  to  explain  what  it  is  that  is  making  him  or  her 
angry. 

3.  Mention  something  the  subordinate  has  done  well  to  show  that  you 

value  him  or  her.  .  (38) 

4.  Wait  for  the  subordinate  to  calm  down  and  then  come  hack  and  solve 
the  problem  later 

5.  Maintain  your  control  by  using  a  firm  tone  of  voice  and  explaining 
the  problems  that  happen  when  a  person  loses  his  or  her  temper  on 
the  job. 


MCQ115 
0.     When    there    are    several    possible    ways    to    solve    a    problem    that    a 

subordinate   faces,    and  you   think   that   some  of  them  would  probably   work 

better  than  others,    it  is  best  to   first: 

1.  •  Ask  the  subordinate  for  the  solution  that  he  or  she  thinks  would 

work  best. 

2.  Write  down  the  solutions  that  you  think  would  work  best,  and  discuss 
them  with  someone  who  has  had  experience  with  similar  problems. 

3.  Express  your  appreciation  for  the  ideas  and  ask  the  subordinate  to 

check  them  out  with  someone  with  more  experience.  (39) 

4.  Act  on  the  solution  that  you  think  is  best  and  have  the  subordinate 
gather  information  about  the  problem  to  make  sure  that  the  solution 
works. 

5.  Call  over  another  subordinate  in  order  to  gain  more  participation  in 
solving  the  problem. 
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At  one  time  or  another,  supervisors  ask  their  subordinates 
for  their  ideas.  In  the  following  questions  we  give  four 
different  reasons  why  a  supervisor  might  ask  subordinates 
for  their  ideas.  Please  read  each  of  the  four  reasons  and 
then  place  a  "1"  by  the  reason  that  best  represents  why 
you  ask  subordinates  for  their  ideas.  Then  place  a  "2"  by 
the  second  best  reason,  and  "3"  by  the  third  best,  and  a 
"4"   by    the    fourth   best   reason. 
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It  is  best   to  ask  subordinates   for  their  ideas  because: 


MCQ116  A_ 

MCQ116B  _ 
MCQ116C  - 


MCQ116D 


A.  You  can  help  subordinates    learn   important   skills   that   they  need 

by  having  them  work  through  problems  themselves.  (40) 

B.  Subordinates  can  help  a  supervisor  out  of  a  tough  situation. 

C     Subordinates  are  more  likely  to  try  the  solution  if  they  have 
had  a  real   part   in  the  decision. 

D.     Since    subordinates    are    closest    to    the    problem,     they    might 

provide  information  you  were  unaware  of.  (43) 


117A- 

117B- 
117C_ 

117D 


It  is  best  to  ask  subordinates   for  their  ideas  because: 

A.     Supervisors   can't   be  expected   to  know  everything  about  each  job, 

so  they  need  to  rely  on  subordinates'   ideas. 

3.     Since  subordinates  are  closest  to  the  problem,   they  probably 
have  the  best  information. 


Going  to  all  the  trouble  to  involve  subordinates  can  be  worth  it 
because  subordinates  may  work  harder  in  the  long  run. 

Subordinates  should  be   involved  simply  because  they  need  to 
learn  and  grow. 


It   is  best  to  ask  subordinates   for  their  ideas   because: 


118A- 
118B- 
118C- 


118D- 


A.  You  can   get   subordinates   to  think  of  your  solution   as   their 
"own"  idea. 

B.  Even    though    the    ideas    may    be    impractical    or    naive,     it    is 
important  for  subordinates  to  feel   involved. 

C     You're  more  likely  to  identify  the  real  problem  if  you  use  the 
subordinates'   expertise. 

D.     Supervisors   are   so    involved    in    managing   that   they   must   rely   on 
the  subordinates  to  work  through  the  problems. 


!51 
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E.   SUPERVISOR  EVALUATION  OF  TRAINING 

This  questionnaire  was  given  to  supervisors  who  had 
been  trained  as  part  of  the  Problem  Solving  Skills  for 
Managers  Training  Program.   It  was  designed  to  measure 
the  supervisors'  reaction  to  the  training  program  and 
their  motivation  as  determined  by  intrinsic  and  extrinsic 
factors . 
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SETQ 
INTERACT  PERFORMANCE  SYSTEMS 
SUPERVISORY  EVALUATION  OF  TRAINING  QUESTIONNAIRE 


(1-4, 


The  purpose  of  this  questionnaire  is  to  measure  your 
opinion  of  the  Interact  training  program  you  have  now 
completed.   Your  answers  will  be  kept  confidential,  so 
please  feel  free  to  say  wnat  you  feel. 


Name  : 


(6-9) 


Once  again,  only  ths  researchers  at  Intera 
Systems  will  nave  access  to  your  survey. 


ct  Performance 


Reprinted  With  Permission 

Copyright,  Interne*.  Performance  Systems,  Inc.,  1982 
All  Rights  ^eservea 
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INSTRUCTIONS 


1.   Most  questions  can  be  answered  by  choosing  one  of  the  answers 
given.   If  you  dc  not  find  the  exact  answer  that  fits  your 
case,  choose  the  one  that  is  closest  to  it. 


2.   Answer  questions  by  circling  the  number  of  your  answer  choice, 
as  shown  in  this  examoie. 


X 

<u 

-J 
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T3 

4J 

0) 

IT! 

JJ 
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o 

Q:   To  what  extent  are  you  satisfied 

with  the  car   you  drive?  1   2   3   4  ©  5   7 

(A  response  of  "5"  would  mean  that  you  are  satisfied 
with  the  car  you  drive  somewhere  between  "some  extent" 
and  "great  extent"  but  closer  to  "seme  extent.") . 


3e  sure  each  answer  is  clear lv  marked. 


PLEAS!  ANSWER  EVERY  QUESTION 
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I.   How  well  do  the  skills  work? 

To  what  extent  are  the  skills  taught 
in  the  program  effective  when  you 
use  them  to: 

SETQIOI^.  Begin  discussing  a  problem  with 
a  subordinate  who  is  performing 
poorly  on  the  job? 

SETQIOlB.   Figure  out  why  a  subordinate  is 
not  performing  well  on  the  tod? 

5ETQ101C.   Encourage  a  poorly  performing  sub- 
ordinate to  want  to  work  harder? 

SETQ101D-   Involve  a  subordinate  in  finding 
a  solution  to  a  tough  problem 
on  the  job? 

SETQ101E-   Get  an  angry  subordinate  to  cairn 
down? 

SETOlOl5"*   Help  a  suborniate  see  that  you 

understand  his  or  her  description 
of  a  complex  problem? 

SETQ101G.   Figure  out  long-term  solutions 
that  will  keep  problems  from 
coming  up  in  the  future? 

SETQ101H.   Make  sure  your  subordinate  under- 
stands exactly  what  you  expect 
him  or  her  to  do  to  solve  a 
problem? 


— 

— 

OJ 

I-* 

BJ 

JJ 

<TS 

jj 

X 

X 

i) 

JJ 

i> 

CO 
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JJ 
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2 

■J) 

U 

(17) 


II.   In  summary,  to  what  extent: 
SETQ102A- 
SETQ102B. 

SETQ102C. 


Do  you  think  the  skills  taught 

actually  work?  12   3   4   5   6 

Do  you  disagree  with  a  lot  of 

what  was  taught  in  the  program?     12   3   4   5   6 


Are  the  skills  taught  in  the 
program  too  soft  so  that  if  you 
use  them  your  subordinates  will 
take  advantage  of  you? 

SETQ102D.   Are  the  skills  taught  in  tne 
program  too  undernanded  so 
tnat  if  you  use  them  you  feel 
you  are  taking  advantage  of  your 
subordinates? 


(28) 
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III.   How  worthwhile  was  the  training? 

To  what  extent  do  you  think  the 
training : 

SETQ103  A.   Was  worth  the  time  and  effort 

spent  on  it?  12   3   4   5   6   7    (29) 

SETQ103B.   Was  an  unpleasant  and  uncom- 
fortable experience?  12   2   4   5   6   7 

SETQ103C.   Was  something  you  enjoyed?         12   3   4   5   6   7 

SETQ103D.   Was  largely  a  waste  of  time 
because  you  had  similar 
training  in  the  past?  12   3   4   5   6   7 

SETQ103--   Was  a  waste  °f  time  because 
it  was  not  related  enough 
to  the  real  supervisory 
problems  you  face?  12   3   4   5   6   7 

SETQ103F.   Made  you  more  comfortable  with 
the  way  you  have  to  treat  your 
subordinates  in  order  to  get 
things  done?  12   3   4   5   6   7 

SETQ103G.   Wasted  valuable  time  that  you 
would  rather  have    spent 
elsewhere?  12   3   4   5   6   7 

IV.   What  kind  of  impact  did  the  training 
have?  ' 

To  what  extent  do  you  think  the 
training : 

SETQ104A-  Improved  your  skills  in  dealing 
with  tough  situations  with  your 
subordinates?  12   3   4   5   6   7 

SETQ104b.   was  something  you  were  able  to 

use  on  a  daily  basis?  12   3   4   5   6   7 

SETQ104c.   Was  something  you  didn't  really 
need  oecause  you  were  satisfied 
with  your  skills  when  the  training 
started?  12   3   4   5   6   7 

SETQ104D.   Helped  you  do  a  better  job?         12   3   4   5   6   7 

SETQ104E-   Benefited  your  subordinates?       12   3   4   5   6   7 

SETQIOA5"'   Increased  the  amount  of  work  your 

subordinates  do?  1   2   3   4   5   5   7    (41) 
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V.   How  did  the  ether  people  who  were  trained 
in  the  same  workshop  group  as  you  feel 

acout  the  program?  <u 

<t  *j 

To  what  extent:  |  J 

oo- 
ETQ105A-   Were  others  in  your  training 

group(s)  cooperative?  12   3   4   5   6   7      (42 

ETQ105B.   Were  they  "involved  "  in  the  training?     12   2   4   5   6   7 

ETQ105C.  Did  they  support  your  efforts  to 
learn  and  practice  the  skills  in 
class?  12   3   4   5   6   7 

ETQ105D-   Did  others  take  the  training 

seriously?  12   3   4   5   6   7 

;ETQ105£,   Were  others  willing  to  try  out  the 

new  behaviors?  12   3   4   5   6   7 


;ETQ105' 


Did  others  seem  to  take  the  training 

as  just  a  game?  12   3   4   5   6   7 

;ETQ105G.   Did  others  seem  to  act  as  if  they 

were  only  sitting  through  the  train- 
ing because  they  were  forced?  12   3   4   5   6   7 

1ETQ105H.   Was  there  an  individual  or  group 

who  resisted  the  program  and  lowered 

the  overall  enthusiasm?  12   2   4   5   6   7 

IETQ105I-   Did  others  benefit  from  the  program?      12   3   4   5   6   7 

1ETQ105J-   Did  others  actually  change  the  ways 

they  work  with  people?  12   3   4   5   6   7 


VI.  How  did  other  people  in  the  organization 
feel  about  the  program? 

5ETQ106A.   Did  the  people  above  you  in  the  chain 

of  command  support  the  program?  12   3   4   5   6   7 

)ETQ106E.   Did  other  key  supervisors  support 

the  program?  12   3   4   5   6   7 

3ETQ106C.   Were  your  subordinates  aware  of 
the  training  program  before  it 
began?  12   3   4   5   6   7 

5ETQ106D.   Were  your  subordinates  generally 

supportive  of  the  training  program?       12   3   4   5   6   7 

3ETQ106E.   Did  your  subordinates  make  fun  of  _ 

your  attempts  to  use  the  skills?  12   3   4   5   6   7 

3ETQ106F-   Did  your  subordinates  support  your 

efforts  to  use  the  skills  with  them?      12   3   4   5   6   7      (57) 
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What  were  the  reasons  for  trying 

the  skills?  — 

IB 

To  what  extent  did  you  try  the         ^ 

Skills:  '-3 


0) 


AJ  E                01 

SETQ107A-   3ecause  the  trainers  were  senior    i  w        c 
to  you  and  not  because  you  thought 

that  the  skills  might  work?         12  3   4  5   6   7     (58) 

SETQ107b.   Because  the  skills  made  sense?      12  3   4  5   6   7 

SETQ107C.   Because  the  skills  seemed  to  work?  12  3   4  5   6   7 

„p.Tnin7D.   Because  vou  felt  comfortable 

bLiyiu/     using  the  skills?                  12  3   4  5   5   7 

SETQ107E.   Because  your  supervisor  supported 

using  the  skills?                 12  3   4  5   6   7    (62) 


VIII-   What  was  it  like  going  through  the 
training? 

SETQ108A*   Overall,  how  would  you  rate  the  number 
of  training  sessions? 

1.  Too  few. 

2.  About  the  right  number. 

3 .  Too  many  . 

SETQ108B.   Overall,  how  would  you  rate  the  pace  of  the 
training? 

1 .  Too  s low  . 

2.  About  right. 

3 .  Too  fast  . 

SETQIQS*--   Overall,  how  would  you  rate  the  complexity 
of  the  training? 

1 .  Too  simple  . 

2.  About  right. 

3.  Too  complex.  '6:5' 
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IX.   How  much  practice  was  done? 

While  you  were  participating  in  training,  op.  the  avera; 

SETQ109  A-   How  mucri  time  was  spent  practicing  the 
Rehearsal  Cards  in  each    session? 

1.  Less  than  5  minutes  5.  31  to  40  minutes 

2.  5  to  10  minutes  6.  41  to  50  minutes 

3.  11  to  20  minutes  7.  51  to  60  minutes 

4.  21  to  30  minutes  8.  61  to  70  minutes 


9.   More  than  70  minutes      (66) 

SETQ1093.   How  many  Rehearsal  Card  situations  did  you  oractice 
when  using  the  cards  in  eacn  session? 

1.  0  to  I  situation  5.  8  to  9  situations 

2.  2  to  3  situations  5.  10  to  11  situations 

3.  4  to  5  situations  7.  12  to  13  situations 

4.  6  to  7  situations  S.  14  to  15  situations 

9.   More  than  15  situations   (6~) 

SETQ109c.   How  many  times  a  week  d_d  you  practice  using  the  skills 
by  fulfilling  a  fixed  contract  to  practice? 

1 .  None 

2 .  One 

3 .  Two 

4.  Three 

(68) 

SETQ109D.   How  many  times  during  a  week  did  you  set  aside  a  time 

or  place  to  look  for  chances  to  use  the  skills  (spontaneous 
contracts ) ? 

1 .  None  5 .  Four 

2 .  One  6 .  Five 

3.  Two  7.  Six 

4.  Three  8.  Seven 


5. 

Four 

6  . 

Five 

7. 

Six 

8. 

Seven 

9. 

Eiaht  O 

Eight  or  more  I  69 , 
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SETQ109E.   How  many  times  between  each  session  did  your  t 
to  you  about  using  the  skills? 


rainer  talk 


None 

One 

Two 

Three 


Four 

Five 

Six 

Seven 

Eight  or  men 


(70) 


X.   How  many  times  did  you  talk  about  the  Interact  training  program 
outside  of  class  each  week?  (Please  write  the  number  of  times  in 
the  box  to  the  right) 


SETQ110A 
SETQ1103 

SETQ110C 
SETQUOd 
SETQ110E 
SETQ110F 


With  other  people  going  through  traininng?   ["" _ 

With  your  instructor  or  other  instructors? 

With  your  supervisor? 

With  your  peers? 

With  your  subordinates? 

With  vour  familv? 


XI.   Overall: 

SETQ111A.   To  what  extent  do  you  value  the 
skills  taught  in  the  program? 


SETQ1113- 

SETQ111 c- 
SETQ111 D. 


To  what  extent  are  you  committed 
to  using  the  techniques  in  the 
program? 

To  what  extent  did  you  become 

excited  about  using 

the  skills  in  the  program? 

To  what  extent  has  this 
program  interested  you  in 
more  training  of  this 
type? 
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(71) 


76) 


:ard  2 


(17) 
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In  interviews  people  have  told  us  that  they  often  don't  use  the 
skills  from  training  programs  as  often  as  they'd  like.   When 
asked  why,  they  explain  that,  while  they  might  want  to  use  the 
skills,  at  times  they  "forget."   They  are  so  used  to  their  old 
ways  of  doing  things,  they  don't  stop  to   think  about  using  the 
new  skills.   In  this  section  we'd  like  tc  ask  you  some  question; 
aoout  this  Droblem. 


XII.   Please  think  of  the  times  you  have  used  skills  from  this 
program,  and  where  you  were  when  you  thought  to  use  the 
skills.   We  would  like  to  know  where  people  are  and  what 
they  are  doing  when  they  "stop  and  think"  of  a  chance  to 

use  these  skills.  ^ 

o 


— <  xj  c 

<Z  0) 


How  frequently  have  the  following  state-  _, 
mer.ts  been  true  for  vcu:  "o 


SETQ112  a.   During  a  training  session  I  thought   5        $         g 
of  an  opportunity  to  use  one  of 
the  skills.  123456   7    (2j) 

SETQ112  b.   I  had  set  aside  a  time  to  look 

for  chances  to  use  the  skills,  and 

during  that  time  I  saw  (or  thought 

of)  a  chance.  12   3   4   5   6   7 

SETQ112  c.   I  was  not  specifically  looking  for 

a  chance  to  use  the  skills,  but 

saw  a  problem  in  my  work  area  and 

thought,  "This  is  a  chance  to  correct 

that  problem  I've  never  gotten 

around  to  solving."  12   3   4   5   6   7 

SETQ112  d.   I  didn't  see  the  chance  to  use 
the  skills  at  first,  out  found 
myself  getting  angry  at  someone 
and  that  reminded  me  to  use  the 
skills.  12   3   4   5   6   7 

SET0112  e*   *  9ot  halfway  into  a  discussion 
and  saw  that  what  I  had  begun 
with  wasn't  working  and  that 
reminded  me  to  use  the  skills.        12   3   4   5   6   7 

SETQ112  f.   I  thought  to  use  the  skills  be- 
cause the  last  time  the  discussion 

had  blown  up  in  my  face  and  i  had     1234567    (26 
said  to  myself,  "Next  time  I'll 
use  the  skil Is. " 
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xii: 
SETQ113A 


Whenever  you  try  something  new,  you  have  to  concentrate 
on  it .  It's  difficult  and  you  have  to  pay  close  attention. 
With  time,  new  activities  become  more  familiar  and  you 
think  about  them  less  and  less.   For  example,  remember 
what  it  was  like  when  you  first  learned  to  drive  a  car? 
It  took  a  lot  of  thought  at  first,  but  with  prac 
became  routine.   The  same  is  true  with  new  super 
skills.   The  following  list  describes  different  s 


tice 
visorj 

tages 
Please  check  the  box  (one  only) 
best  describes  your  use  of  the  new  supervisory  skills. 


Hie   ~- 


thi 


ange  process 


I  almost  never  use  the  new  skills  witr.out 
"being  aware  of  it"  because  they  are  still 
unfamiliar  and  take  conscious  effort. 

I  occasionally  use  the  new  skills  without 
"being  aware  of  it"  because  they  are 
becoming  more  familiar  and  take  less 
conscious  effort. 

I  frequently  use  the  new  skills  without 
"being  aware  cf  it"  oecause  tney  are 
becoming  more  familiar  and  take  less 
conscious  effort. 

I  nearly  always  use  the  skills  without 
"being  aware  of  it"  because  they  are 
auite  familiar  and  take  little  conscious 


XIV.   How 
the 

SETQIUa. 

SETQIUb. 

SETQIUc. 

SETQ114d. 

SETQ114e. 


frequently  do  you  use  skills  frc 
training  program.  .  . 

At  home  with  your  family? 

At  work  with  your  subordinates? 

At  work  with  other  supervisors? 

At  work  with  your  immediate 
supervisor? 

In  volunteer   settings  (at 
church,  clubs,  etc.) 


(27) 


uu 

i 

~ 

t/j 

4J 

V 

c 

0J 

<-* 

■h 

3 

~^ 

JJ 

U" 

TO 
U 

ra 

u 

U-l 

10 

0) 

> 

—1 

> 

S-l 

0 

0) 

0J 

2 

C/3 

> 

1 

2 

3 

4 

5 

6 

7 

1 

2 

3 

4 

5 

6 

7 

1 

2 

3 

4 

5 

6 

7 

1 

2 

3 

4 

5 

6 

7 

(28) 
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XV.   How  frequently  do  you  use  the 

different  skills  in  the  program? 

SETQ115a.  Communicating  the  situation?  12   3   4   5   6      \2>2,', 

SETQ115D-  Using  positive  reinforcement? 

SETQ115C"  Solving  motivation  problems? 

SET0115^-  Solving  ability  problems? 

SETQ115e.  Solving  emergent  problems?  12   3   4   5   6   7   (37) 


XVI.   Please  rank  order  the  usefulness  of  the  different  skills  in 

the  program.   Place  a  "1"  by  the  skill  you  find  most  useful, 

a  "2"  by  the  second  most  useful,  a  "3"  by  the  third  most 

useful  ,  a  "  4 "  by  the  fourth  most  useful,  and  a  "  £ "  oy  the 
fifth  most  useful. 

SET0116  a<   Communicating  the  situation.       (38) 

SFT0116  b"   Using  positive  reinforcement.      

SETQ116  c.   Solving  motivation  problems.       

SETQ116  d.   Solving  ability  problems.  


SETQ116  e.   Solving  emergent  problems.        '    (42) 

XVII.  Please  rank  order  the  training  sessions  by  how  interesting 

they  were  for  you.   Place  a  "1"  by  the  most  interesting  session, 
a  "2"  by  the  second  most  interesting,  a  "3"  by  the  third  most 
interesting  and  a  "4"  by  the  fourth  most  interesting. 

SETQ117a-   The  session  covering  communicating 

the  situation  and  positive  reinforcement.     (43) 

SETQ1170-   -he  session  covering  motivation  problems.     

SETQ117C-   The  session  covering  ability  proDlems.        


SETQ117*-   Ttae  session  covering  emergent  problems.       (46) 

XVIII.   if  you  were  in  charge  of  the  training  and  interested  in 

getting  people  to  see  all  the  opportunities  to  use  the  skills, 
what  would  vou  do? 
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APPENDIX    B 
SUBQ   PART    III    FACTOR   ANALYSIS   DOCUMENTATION 

A.       EIGENVALUES,    MEANS   AND    STANDARD   DEVIATIONS 


Variable 

Esc.    Communalicy 

Factor 

Eigenvalue        ! 

?ct.    or"   Var. 

Cua.    Pec. 

Mean 

Standard    Dev. 

Cases 

SUBQ109A 

0.87390 

1 

22.73058 

46 . 4 

46.4 

4.4783 

i  .5653 

92 

SUBQ109E 

0.37936 

2 

^  .  32835 

3.8 

55.2 

4.4674 

l.o538 

92 

SUBQ109C 

0.92476 

3 

2.07609 

4.2 

59.5 

4.2500 

1.5236 

92 

SUBQ109D 

0.83104 

4 

1.59553 

3.3 

62.7 

4.2500 

1.72^3 

92 

SUBQ109E 

0.77579 

5 

1.50208 

3.1 

65.8 

3.5761 

1.7112 

92 

SUBQ109F 

0.83852 

6 

1.27250 

2.6 

68.4 

3.2717 

1.6515 

92 

SUBQ109G 

0.84904 

7 

1.20079 

2.5 

70. S 

3.1196 

1.6893 

92 

SUBQ109H 

0.72915 

3 

1.13418 

2.3 

73.1 

3.3587 

1.7452 

92 

SUBQ109I 

0.65462 

9 

1.06750 

2.2 

75.3 

3.5543 

1.6796 

92 

SUBQ109J 

0.91061 

10 

0.97399 

2.0 

77.3 

4.6957 

1.5100 

92 

SUBQ109K 

0.88108 

11 

0.90176 

1.3 

79.2 

4.4457 

1.6533 

92 

SUBQ109L 

0.79981 

12 

0.84451 

1.7 

80.9 

3.4130 

1.7675 

92 

SUBQ109M 

0.87280 

13 

0.75969 

1.6 

82.4 

3.4674 

1.7331 

92 

SUBQ109N 

0.88295 

14 

0.73078 

1.5 

83.9 

4.2826 

1.6194 

92 

SUBQ 1090 

0.88980 

15 

0.66443 

1.4 

85.3 

4.2826 

1.6058 

92 

SUBQ109P 

0.75559 

16 

0.64252 

1.3 

86.6 

3.2935 

1.3784 

92 

SUBQ110A 

0. 795*9 

17 

0.60701 

1.2 

87.8 

4.5000 

1.5724 

92 

SUBQ U OB 

0.36575 

18 

0.56344 

l.l 

89.0 

4.5326 

1.5860 

92 

SUBQ111A 

0.86496 

19 

0.43170 
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